Jul 03 02:20:54.427766 np0000004352 systemd[1]: Started devstack@c-bak.service - Devstack devstack@c-bak.service. Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: we strongly recommend against using it for new projects. Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: If you are already using Eventlet, we recommend migrating to a different Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: framework. For more detail see Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 02:20:54.555001 np0000004352 cinder-backup[101397]: import eventlet # noqa Jul 03 02:20:55.540340 np0000004352 cinder-backup[101397]: INFO cinder.cmd.backup [-] Backup running in single process mode. Jul 03 02:20:55.641637 np0000004352 cinder-backup[101397]: INFO dbcounter [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Registered counter for database cinder Jul 03 02:20:55.679810 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:20:55.766813 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writer thread running {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 02:20:55.770317 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 03 02:20:55.772325 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Jul 03 02:20:55.774023 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 02:20:55.775556 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 02:20:55.777535 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 02:20:55.779233 np0000004352 cinder-backup[101397]: INFO cinder.rpc [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 02:20:55.824936 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:20:55.838483 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Acquiring lock "singleton_lock" {{(pid=101397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 02:20:55.838632 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Acquired lock "singleton_lock" {{(pid=101397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 02:20:55.838787 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Releasing lock "singleton_lock" {{(pid=101397) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 02:20:55.838983 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ******************************************************************************** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 02:20:55.839078 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Configuration options gathered from: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 02:20:55.839207 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 02:20:55.839346 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 02:20:55.839441 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ================================================================================ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 02:20:55.839606 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allow_availability_zone_fallback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840001 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allow_compression_on_image_upload = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840001 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allowed_direct_url_schemes = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840001 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] api_rate_limit = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840160 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] auth_strategy = keystone {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840227 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backdoor_port = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840353 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backdoor_socket = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840691 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840691 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_api_class = cinder.backup.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840780 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_compression_algorithm = zlib {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.840867 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_create_containers = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841020 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841188 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver_init_check_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841343 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver_stats_polling_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841508 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841651 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_max_operations = 15 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841804 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_metadata_version = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.841959 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_name_template = backup-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842098 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_native_threads_pool_size = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842255 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_object_number_per_notification = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842398 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_service_inithost_offload = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842564 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth = per_user {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842701 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842844 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_url = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.842987 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843122 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_block_size = 32768 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843259 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843381 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_container = volumebackups {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843505 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_create_storage_policy = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843606 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_enable_progress_timer = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843702 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_key = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843818 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_object_size = 52428800 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.843925 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_project = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844042 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_project_domain = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844159 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844284 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_retry_attempts = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844406 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_retry_backoff = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844552 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_service_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844659 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_tenant = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.844896 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_url = https://10.4.3.223:8080/v1/AUTH_ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845013 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845118 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_user_domain = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845234 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_timer_interval = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845338 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_use_same_host = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845452 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_use_temp_snapshot = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845558 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_workers = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845664 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chap_password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845782 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chap_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.845909 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846078 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_internal_tenant_project_id = 83082817483c49afbbcd4607429e1931 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846237 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_internal_tenant_user_id = 3ee3da91b9014531bc57cb1ab02e0fa8 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846386 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] compression_format = gzip {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846566 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_dir = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846692 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846840 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_source = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.846984 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847123 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] control_exchange = openstack {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847280 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] debug = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847438 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847587 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_group_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847797 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.847953 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_volume_type = storpool {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848089 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] disk_geometry = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848236 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_client_cert = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848371 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_client_cert_key = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848523 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_data_namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848658 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_ssl_cert_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848795 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_ssl_cert_verify = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.848931 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849072 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enable_new_services = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849219 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enable_unsupported_driver = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849371 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enabled_backends = ['storpool'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849527 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enforce_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849665 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] filter_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849799 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.849948 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_servers = ['https://10.4.3.223/image'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850081 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_ssl_compression = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850229 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850373 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_catalog_info = image:glance:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850523 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850697 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850829 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.850972 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_num_retries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851106 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_request_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851250 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] goodness_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851398 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] graceful_shutdown_timeout = 5 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851562 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] group_api_class = cinder.group.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851705 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] host = np0000004352 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851841 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_compress_on_upload = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.851980 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_address_space_limit = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852112 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_cpu_limit = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852317 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852475 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_disable = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852613 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_upload_use_cinder_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852751 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_upload_use_internal_tenant = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.852905 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853049 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_max_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853219 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_max_size_gb = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853368 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] instance_format = [instance: %(uuid)s] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853529 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853677 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iscsi_target_flags = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853822 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iscsi_write_cache = on {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.853968 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854176 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854326 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854493 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854634 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854777 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_color = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.854918 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_config_append = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855066 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855212 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_dir = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855349 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855501 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_options = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855650 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotate_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855798 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotate_interval_type = days {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.855941 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotation_type = none {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856053 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856178 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856323 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856487 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856603 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856744 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_age = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.856879 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_logfile_count = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857014 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_logfile_size_mb = 200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857176 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_over_subscription_ratio = 20.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857314 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] message_reap_interval = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857462 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] message_ttl = 2592000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857603 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] monkey_patch = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857742 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] monkey_patch_modules = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.857857 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] my_ip = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858001 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] no_snapshot_gb_quota = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858138 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_iser_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858279 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_shell_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858412 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_volume_device_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858568 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmeof_conn_info_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858701 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmet_ns_id = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858836 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmet_port_id = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.858978 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_max_limit = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859119 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_ext_list = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859281 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859425 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859586 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_listen_port = 8776 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859726 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.859861 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_workers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860000 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] per_volume_size_limit = -1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860145 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] periodic_fuzzy_delay = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860284 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] periodic_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860424 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860576 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] public_endpoint = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860714 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] publish_errors = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860854 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_backup_gigabytes = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.860999 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_backups = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861155 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861289 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_gigabytes = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861427 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_groups = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861581 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_snapshots = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861722 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_volumes = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861860 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_burst = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.861998 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_except_level = CRITICAL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862140 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_interval = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862281 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] replication_device = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862413 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] report_discard_supported = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862576 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] report_interval = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862756 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reservation_clean_interval = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.862873 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reservation_expire = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863015 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reserved_image_namespaces = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863163 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reserved_percentage = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863306 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863469 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863625 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rpc_response_timeout = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863777 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] run_external_periodic_tasks = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.863918 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864200 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scst_target_driver = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864338 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scst_target_iqn_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864517 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_down_time = 720 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864672 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] shell_completion = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864820 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] snapshot_name_template = snapshot-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.864982 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865093 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] state_path = /opt/stack/data/cinder {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865258 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] storage_availability_zone = nova {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865401 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] storage_protocol = iSCSI {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865566 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865713 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] syslog_log_facility = LOG_USER {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.865857 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_helper = lioadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866053 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866314 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866485 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866644 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_protocol = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866793 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_secondary_ip_addresses = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.866942 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] trace_flags = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867080 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867230 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] transport_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867373 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] until_refresh = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867550 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_chap_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867699 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_default_quota_class = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867840 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_journal = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.867985 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_json = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868124 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868276 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_stderr = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868413 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_syslog = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868581 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] verify_glance_signatures = enabled {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868734 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.868876 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_api_class = cinder.volume.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869011 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_backend_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869163 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear = zero {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869304 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear_ionice = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869466 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear_size = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869614 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869753 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_copy_bps_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.869911 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_dd_blocksize = 1M {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.870066 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.870232 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_name_template = volume-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.870384 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_usage_audit_period = month {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.870599 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.870754 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_concurrency.disable_process_locking = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.870902 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871110 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871271 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871412 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871577 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871722 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.871868 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872020 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872175 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872331 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872504 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872659 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_version = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872816 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.cache = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.872969 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873123 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873283 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873448 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873591 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873732 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.873871 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.include_service_catalog = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874010 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874166 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.interface = public {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874304 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874468 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_password = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874609 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874752 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.874895 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875034 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875199 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875359 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875501 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875637 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875776 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.875928 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876066 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876214 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876354 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876505 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876644 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876796 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.876931 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877076 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877226 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877360 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877514 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877658 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.223/identity {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877810 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend = dogpile.cache.null {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.877954 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend_argument = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878091 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend_expiration_time = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878244 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.config_prefix = cache.oslo {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878383 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.debug_cache_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878550 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enable_retry_client = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878710 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enable_socket_keepalive = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878849 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.878976 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.expiration_time = 600 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879124 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879290 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_retry_attempts = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879469 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879624 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_dead_retry = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879764 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.879911 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880049 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_maxsize = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880193 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880329 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_sasl_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880500 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880640 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880779 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.proxies = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.880916 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_db = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881058 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881217 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881361 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_server = localhost:6379 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881523 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.retry_attempts = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881677 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.retry_delay = 0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881836 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_count = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.881971 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_idle = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882097 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882257 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_timeout = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882414 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_allowed_ciphers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882591 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882736 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.882874 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883009 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883158 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.username = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883307 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] coordination.backend_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883470 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.asyncio_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883604 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.asyncio_slave_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883747 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.backend = sqlalchemy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.883890 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884031 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_debug = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884188 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_parameters = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884355 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_recycle_time = 3600 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884513 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_trace = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884674 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_inc_retry_interval = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884825 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_max_retries = 20 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.884974 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_max_retry_interval = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885143 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_retry_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885300 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_overflow = 50 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885459 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_pool_size = 5 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885603 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_retries = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885748 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.885884 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.mysql_wsrep_sync_wait = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886020 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.pool_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886167 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.retry_interval = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886303 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.slave_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886456 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.sqlite_synchronous = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886597 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.synchronous_reader = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886730 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.use_db_reconnect = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.886872 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887009 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887160 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887309 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887463 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887617 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.connection_string = messaging:// {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887779 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.887944 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_doc_type = notification {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888104 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_scroll_size = 10000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888262 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_scroll_time = 2m {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888399 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.filter_error_trace = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888569 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.hmac_keys = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888729 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.sentinel_service_name = mymaster {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.888873 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.socket_timeout = 0.1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889011 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.trace_requests = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889157 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.trace_sqlalchemy = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889311 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_jaeger.process_tags = {} {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889466 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_jaeger.service_name_prefix = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889609 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_otlp.service_name_prefix = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889764 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.enforce_new_defaults = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.889904 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.enforce_scope = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890054 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_default_rule = default {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890226 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890368 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_file = policy.yaml {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890534 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890675 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890811 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.890952 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891110 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891267 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891382 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891503 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.group = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891607 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.helper_command = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891705 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891811 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.891915 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892013 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892117 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892232 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.group = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892330 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.helper_command = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892449 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892557 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892655 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892750 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892853 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.892960 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893057 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893164 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893264 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893362 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893475 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893585 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.send_service_user_token = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893675 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893773 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893874 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.893982 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894084 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894190 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894288 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894385 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894507 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894616 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894715 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894812 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.894920 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.backend_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895023 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chap_password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895123 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chap_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895234 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895330 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.disk_geometry = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895439 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_client_cert = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895547 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_client_cert_key = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895659 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_data_namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895793 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.895927 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896055 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896196 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896345 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896582 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.filter_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896686 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.goodness_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896785 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896882 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.896976 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897076 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897189 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897293 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iscsi_target_flags = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897394 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iscsi_write_cache = on {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897513 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897677 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897779 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897883 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.897990 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898086 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898196 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_shell_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898298 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898396 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898516 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898615 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898710 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.replication_device = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898806 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.report_discard_supported = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.898908 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.reserved_percentage = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899011 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899107 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899221 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899323 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899486 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899590 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899693 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899793 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_protocol = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899897 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.899994 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.trace_flags = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900089 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.unique_fqdn_network = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900203 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.use_chap_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900301 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900396 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_backend_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900521 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear = zero {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900617 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear_ionice = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900715 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear_size = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900814 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.900911 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901011 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901154 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901258 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.file_event_handler = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901358 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901470 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.log_dir = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901579 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901682 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901776 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901875 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.901975 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902071 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902180 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902284 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902383 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.hostname = np0000004352 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902500 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902602 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902705 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902805 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.902905 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903008 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903105 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903213 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903315 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903412 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903534 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903627 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903724 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903818 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.903917 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904009 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904103 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904211 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904307 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904405 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904523 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904624 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904728 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904823 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.904919 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905017 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905115 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905225 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905331 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.driver = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905445 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.retry = -1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905556 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905651 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905761 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.905958 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906058 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_api_version = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906168 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_endpoint = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906271 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_endpoint_type = public {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906367 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906484 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906580 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906679 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906777 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906872 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.906970 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.number_of_retries = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907069 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.retry_delay = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907178 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.send_service_user_token = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907276 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907371 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907487 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.verify_ssl = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907587 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.verify_ssl_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907686 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907786 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.auth_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907878 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.907991 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908091 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908225 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908298 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908395 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908515 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908618 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.approle_role_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908713 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.approle_secret_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908817 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_mountpoint = secret {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.908913 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909009 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_version = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909105 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909215 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.root_token_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909311 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.ssl_ca_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909412 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909533 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909720 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.909806 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ******************************************************************************** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 02:20:55.909964 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Full set of CONF: {{(pid=101397) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:275}} Jul 03 02:20:55.910043 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ******************************************************************************** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 02:20:55.910115 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] Configuration options gathered from: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 02:20:55.910207 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 02:20:55.910285 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 02:20:55.910358 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ================================================================================ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 02:20:55.910491 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allow_availability_zone_fallback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910567 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allow_compression_on_image_upload = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910642 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] allowed_direct_url_schemes = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910716 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] api_rate_limit = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910789 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] auth_strategy = keystone {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910860 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backdoor_port = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.910932 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backdoor_socket = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911004 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911075 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_api_class = cinder.backup.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911158 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_compression_algorithm = zlib {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911231 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_create_containers = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911303 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver = cinder.backup.drivers.swift.SwiftBackupDriver {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911374 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver_init_check_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911467 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_driver_stats_polling_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911546 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911620 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_max_operations = 15 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911693 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_metadata_version = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911764 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_name_template = backup-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911836 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_native_threads_pool_size = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911907 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_object_number_per_notification = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.911978 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_service_inithost_offload = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912049 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth = per_user {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912123 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912206 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_url = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912278 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_auth_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912349 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_block_size = 32768 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912428 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_ca_cert_file = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912513 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_container = volumebackups {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912591 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_create_storage_policy = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912658 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_enable_progress_timer = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912729 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_key = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912800 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_object_size = 52428800 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912872 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_project = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.912943 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_project_domain = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913015 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913085 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_retry_attempts = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913170 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_retry_backoff = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913282 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_service_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913381 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_tenant = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913474 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_url = https://10.4.3.223:8080/v1/AUTH_ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913550 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913622 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_swift_user_domain = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913695 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_timer_interval = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913769 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_use_same_host = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913841 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_use_temp_snapshot = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913911 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backup_workers = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.913984 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chap_password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914056 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chap_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914126 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914212 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_internal_tenant_project_id = 83082817483c49afbbcd4607429e1931 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914287 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_internal_tenant_user_id = 3ee3da91b9014531bc57cb1ab02e0fa8 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914358 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] compression_format = gzip {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914446 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_dir = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914524 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914596 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] config_source = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914666 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914738 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] control_exchange = openstack {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914809 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] debug = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914879 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.914950 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_group_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915028 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'swiftclient=WARN', 'botocore=WARN'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915106 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] default_volume_type = storpool {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915179 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] disk_geometry = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915252 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_client_cert = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915324 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_client_cert_key = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915395 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_data_namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915486 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_ssl_cert_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915556 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_ssl_cert_verify = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915628 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] driver_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915701 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enable_new_services = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915771 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enable_unsupported_driver = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915865 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enabled_backends = ['storpool'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.915944 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] enforce_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916013 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] filter_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916084 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916165 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_servers = ['https://10.4.3.223/image'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916235 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_api_ssl_compression = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916305 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_ca_certificates_file = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916376 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_catalog_info = image:glance:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916464 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916542 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916627 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916703 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_num_retries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916774 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance_request_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916843 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] goodness_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.916931 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] graceful_shutdown_timeout = 5 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917004 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] group_api_class = cinder.group.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917077 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] host = np0000004352 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917162 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_compress_on_upload = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917236 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_address_space_limit = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917307 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_cpu_limit = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917376 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917478 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_conversion_disable = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917554 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_upload_use_cinder_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917623 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_upload_use_internal_tenant = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917694 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917788 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_max_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917823 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] image_volume_cache_max_size_gb = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917917 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] instance_format = [instance: %(uuid)s] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.917987 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918059 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iscsi_target_flags = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918128 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iscsi_write_cache = on {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918211 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918283 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918353 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918430 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918514 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_catalog_info = identity:Identity Service:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918585 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_color = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918665 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_config_append = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918752 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918827 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_dir = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918900 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.918989 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_options = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919062 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotate_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919140 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotate_interval_type = days {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919236 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] log_rotation_type = none {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919310 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919380 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919469 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919543 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919613 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919685 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_age = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919756 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_logfile_count = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919826 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_logfile_size_mb = 200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919896 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] max_over_subscription_ratio = 20.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.919984 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] message_reap_interval = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920059 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] message_ttl = 2592000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920138 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] monkey_patch = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920221 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] monkey_patch_modules = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920294 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] my_ip = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920365 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] no_snapshot_gb_quota = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920456 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_iser_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920531 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_shell_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920601 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] num_volume_device_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920673 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmeof_conn_info_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920744 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmet_ns_id = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920810 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] nvmet_port_id = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920880 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_max_limit = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.920964 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_ext_list = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921043 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921114 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_listen = 0.0.0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921212 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_listen_port = 8776 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921285 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921353 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] osapi_volume_workers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921434 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] per_volume_size_limit = -1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921512 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] periodic_fuzzy_delay = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921583 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] periodic_interval = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921655 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] project_id_regex = [0-9a-f\-]+ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921725 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] public_endpoint = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921795 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] publish_errors = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921865 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_backup_gigabytes = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.921934 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_backups = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922028 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922103 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_gigabytes = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922190 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_groups = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922261 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_snapshots = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922331 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] quota_volumes = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922401 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_burst = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922512 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_except_level = CRITICAL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922597 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rate_limit_interval = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922672 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] replication_device = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922741 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] report_discard_supported = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922811 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] report_interval = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922882 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reservation_clean_interval = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.922967 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reservation_expire = 86400 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923058 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reserved_image_namespaces = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923141 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] reserved_percentage = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923234 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923321 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923400 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] rpc_response_timeout = 120 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923505 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] run_external_periodic_tasks = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923581 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923653 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scst_target_driver = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923724 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] scst_target_iqn_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923795 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_down_time = 720 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923865 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] shell_completion = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.923936 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] snapshot_name_template = snapshot-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924032 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924107 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] state_path = /opt/stack/data/cinder {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924194 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] storage_availability_zone = nova {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924268 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] storage_protocol = iSCSI {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924355 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] swift_catalog_info = object-store:swift:publicURL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924449 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] syslog_log_facility = LOG_USER {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924565 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_helper = lioadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924643 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924714 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924784 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924856 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_protocol = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.924928 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] target_secondary_ip_addresses = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925024 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] trace_flags = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925107 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] transfer_api_class = cinder.transfer.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925196 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] transport_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925267 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] until_refresh = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925352 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_chap_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925451 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_default_quota_class = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925538 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_journal = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925611 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_json = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925682 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925753 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_stderr = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925822 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] use_syslog = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925890 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] verify_glance_signatures = enabled {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.925961 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926053 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_api_class = cinder.volume.api.API {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926127 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_backend_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926211 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear = zero {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926281 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear_ionice = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926363 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_clear_size = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926459 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926556 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_copy_bps_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926630 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_dd_blocksize = 1M {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926702 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926770 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_name_template = volume-%s {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926839 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volume_usage_audit_period = month {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926911 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 02:20:55.926997 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_concurrency.disable_process_locking = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927089 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927183 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927258 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927330 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927430 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927521 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927593 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927670 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927746 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927828 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927901 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.927997 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.auth_version = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928121 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.cache = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928250 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928356 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928496 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.delay_auth_decision = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928609 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928721 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.http_connect_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928835 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.928933 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.include_service_catalog = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929025 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929115 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.interface = public {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929222 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929318 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_password = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929414 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929531 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929621 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929694 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929766 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929837 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929909 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.929980 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930053 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930151 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930228 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930301 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930369 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930468 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930545 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcache_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930620 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930692 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930763 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930834 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_token_roles_required = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930905 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.service_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.930977 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.token_cache_time = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931047 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] keystone_authtoken.www_authenticate_uri = https://10.4.3.223/identity {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931157 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend = dogpile.cache.null {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931233 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend_argument = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931307 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.backend_expiration_time = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931378 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.config_prefix = cache.oslo {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931481 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.debug_cache_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931558 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enable_retry_client = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931631 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enable_socket_keepalive = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931703 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931774 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.expiration_time = 600 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931848 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931921 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_retry_attempts = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.931993 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932065 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_dead_retry = 300 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932164 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932240 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932335 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_maxsize = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932460 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932544 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_sasl_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932618 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932694 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932801 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.proxies = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932890 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_db = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.932966 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_sentinel_service_name = mymaster {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933039 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933112 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.redis_server = localhost:6379 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933210 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.retry_attempts = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933283 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.retry_delay = 0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933378 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_count = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933487 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_idle = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933565 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_keepalive_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933637 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.socket_timeout = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933709 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_allowed_ciphers = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933780 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933850 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933922 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.933992 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.tls_keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934062 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cache.username = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934160 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] coordination.backend_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934250 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.asyncio_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934323 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.asyncio_slave_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934394 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.backend = sqlalchemy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934507 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934592 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_debug = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934665 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_parameters = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934736 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_recycle_time = 3600 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934805 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.connection_trace = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934874 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_inc_retry_interval = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.934943 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_max_retries = 20 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935012 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_max_retry_interval = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935081 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.db_retry_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935168 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_overflow = 50 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935251 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_pool_size = 5 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935324 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.max_retries = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935396 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935495 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.mysql_wsrep_sync_wait = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935570 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.pool_timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935641 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.retry_interval = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935710 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.slave_connection = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935781 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.sqlite_synchronous = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935850 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.synchronous_reader = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935921 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] database.use_db_reconnect = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.935996 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936068 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936145 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936238 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936324 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936404 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.connection_string = messaging:// {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936531 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936632 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_doc_type = notification {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936738 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_scroll_size = 10000 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.936897 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.es_scroll_time = 2m {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937077 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.filter_error_trace = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937178 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.hmac_keys = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937272 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.sentinel_service_name = mymaster {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937349 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.socket_timeout = 0.1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937434 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.trace_requests = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937516 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler.trace_sqlalchemy = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937594 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_jaeger.process_tags = {} {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937665 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_jaeger.service_name_prefix = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937739 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] profiler_otlp.service_name_prefix = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937815 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.enforce_new_defaults = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937886 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.enforce_scope = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.937957 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_default_rule = default {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938064 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938113 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.policy_file = policy.yaml {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938180 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938268 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938345 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938432 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938535 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938621 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_policy.remote_timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938703 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938776 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.group = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938846 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.helper_command = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938916 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.938988 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939059 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.thread_pool_size = 16 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939142 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] privsep_osbrick.user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939226 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939310 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.group = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939383 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.helper_command = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939477 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939550 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939621 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.thread_pool_size = 16 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939693 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] cinder_sys_admin.user = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939770 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939844 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939913 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.939984 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940055 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940127 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940215 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940301 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.send_service_user_token = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940378 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940486 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] service_user.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940583 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940658 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.auth_type = password {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940730 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940802 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940873 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.940945 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941015 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941121 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941227 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941317 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] glance.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941404 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.backend_availability_zone = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941507 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chap_password = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941582 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chap_username = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941653 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941726 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.disk_geometry = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941796 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_client_cert = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941866 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_client_cert_key = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.941937 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_data_namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942008 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942080 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942162 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.driver_use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942237 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.enable_unsupported_driver = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942323 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942398 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.filter_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942518 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.goodness_function = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942597 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942671 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942742 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942819 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.942934 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943046 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iscsi_target_flags = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943170 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iscsi_write_cache = on {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943287 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943402 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943540 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943651 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943754 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943866 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.943944 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_shell_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944017 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944088 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944181 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944277 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.nvmet_port_id = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944351 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.replication_device = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944429 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.report_discard_supported = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944540 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.reserved_percentage = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944648 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.scst_target_driver = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944765 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.scst_target_iqn_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944883 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.storage_protocol = iSCSI {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.944998 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_helper = tgtadm {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945102 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_ip_address = 10.4.3.223 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945221 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_port = 3260 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945326 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945431 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_protocol = iscsi {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945543 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945643 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.trace_flags = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945738 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.unique_fqdn_network = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945812 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.use_chap_auth = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945895 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.945974 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_backend_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946047 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear = zero {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946120 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear_ionice = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946205 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_clear_size = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946279 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946350 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946461 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946542 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946619 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.file_event_handler = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946692 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946763 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_reports.log_dir = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946842 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946916 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.946988 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947061 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947139 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947215 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947289 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947365 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947477 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.hostname = np0000004352 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947541 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947613 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947684 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947760 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947832 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947904 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.processname = cinder-backup {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.947974 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948050 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948125 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948216 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948291 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948364 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948459 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948543 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948615 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948688 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948760 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948832 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948903 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.948975 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949045 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949116 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949198 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949270 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949342 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949413 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949512 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.ssl_version = {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949594 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949665 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.driver = [] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949738 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.retry = -1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949812 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949886 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] oslo_messaging_notifications.transport_url = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.949963 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950042 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950113 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_api_version = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950197 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_endpoint = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950268 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_endpoint_type = public {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950340 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.barbican_region_name = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950411 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950507 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950581 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950708 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950708 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950781 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.number_of_retries = 60 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950851 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.retry_delay = 1 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.950940 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.send_service_user_token = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951028 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951102 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951195 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.verify_ssl = True {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951307 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican.verify_ssl_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951394 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.auth_section = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951495 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.auth_type = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951569 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.cafile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951641 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.certfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951713 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.collect_timing = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951785 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.insecure = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951855 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.keyfile = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951926 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.split_loggers = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.951998 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] barbican_service_user.timeout = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952101 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.approle_role_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952218 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.approle_secret_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952297 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_mountpoint = secret {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952370 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_path = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952465 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.kv_version = 2 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952543 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.namespace = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952614 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.root_token_id = **** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952684 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.ssl_ca_crt_file = None {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952754 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.timeout = 60.0 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952823 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.use_ssl = False {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952896 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 02:20:55.952964 np0000004352 cinder-backup[101397]: DEBUG oslo_service.backend._eventlet.service [None req-c1f9df01-5b20-40e8-9960-412959ed3424 None None] ******************************************************************************** {{(pid=101397) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 02:20:55.953259 np0000004352 cinder-backup[101397]: INFO cinder.service [-] Starting cinder-backup node (version 28.1.0) Jul 03 02:20:55.962901 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Acquiring lock "cleanup_incomplete_backups_101397" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 02:20:55.963325 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Lock "cleanup_incomplete_backups_101397" acquired by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 02:20:55.963464 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Cleaning up incomplete backup operations. Jul 03 02:20:55.979757 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.lockutils [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Lock "cleanup_incomplete_backups_101397" "released" by "cinder.backup.manager.BackupManager._cleanup_incomplete_backup_operations" :: held 0.016s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 02:20:56.013864 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:20:56.018760 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:20:56.024019 np0000004352 cinder-backup[101397]: INFO cinder.keymgr.migration [None req-534bfac7-d0fc-4d87-beb6-0a36e6abd4c5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 02:20:56.029681 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Creating RPC server for service cinder-backup {{(pid=101397) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 02:20:56.033120 np0000004352 cinder-backup[101397]: DEBUG cinder.service [None req-788552da-d728-44a3-90a4-f611e8a109cb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=101397) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 02:21:06.032662 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:22:03.052649 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:22:03.052649 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:23:03.056114 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:23:03.056530 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:23:06.054414 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:24:03.060870 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:24:03.061287 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:25:03.058916 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:25:03.059393 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:25:06.056309 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:25:08.935867 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Create backup started, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de volume: 059f1d91-f732-47bb-9318-702568c735b5. Jul 03 02:25:08.941915 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1527288963',created_at=2026-07-03T02:25:08Z,data_timestamp=2026-07-03T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-803935417',encryption_key_id=None,fail_reason=None,host='np0000004352',id=31069b3b-dc00-4c13-b0ee-ac97e3be76de,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b6e5e42911f443509ca8ff0cf5f8b69d',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='82ee902b7e5e447b81121a5ca6e883f9',volume_id=059f1d91-f732-47bb-9318-702568c735b5) Jul 03 02:25:08.972528 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_b6e5e42911f443509ca8ff0cf5f8b69d {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:08.972637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:08.973136 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:08.973896 np0000004352 cinder-backup[101397]: INFO oslo.privsep.daemon [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmputv51ax8/privsep.sock'] Jul 03 02:25:08.981828 np0000004352 sudo[118468]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmputv51ax8/privsep.sock Jul 03 02:25:08.982756 np0000004352 sudo[118468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:09.212536 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 02:25:09.212668 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 02:25:09.212971 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 02:25:09.212971 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 02:25:09.213086 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 02:25:09.213137 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 02:25:09.213261 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 02:25:09.213356 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 02:25:09.213485 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 02:25:09.517540 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 02:25:09.517629 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 02:25:09.517744 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 02:25:09.517802 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 02:25:09.517877 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 02:25:09.517971 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 02:25:09.518054 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 02:25:09.518127 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 02:25:09.518195 np0000004352 cinder-backup[101397]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 02:25:09.729734 np0000004352 sudo[118468]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:09.736167 np0000004352 cinder-backup[101397]: INFO oslo.privsep.daemon [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Spawned new privsep daemon via rootwrap Jul 03 02:25:09.736167 np0000004352 cinder-backup[101397]: DEBUG oslo.privsep.daemon [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Accepted privsep connection to /tmp/tmputv51ax8/privsep.sock {{(pid=101397) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 02:25:09.876130 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:25:09.876545 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.nvmeof [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jul 03 02:25:09.902525 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:09.914941 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:25:09.915441 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:25:09.925939 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:25:09.927812 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe29:2001', 'fe80::f84b:8bff:fe85:9029', 'fe80::fc16:3eff:fe6e:9555', 'fe80::9894:1dff:fe25:4235', 'fe80::fc16:3eff:fec5:3c01', 'fe80::fc16:3eff:fe13:5dd6', 'fe80::fc16:3eff:fea7:3f6c', 'fe80::fc16:3eff:fe42:b902', 'fe80::fc16:3eff:fe5e:d569', 'fe80::24b8:65ff:fea0:5e6b', 'fe80::fc16:3eff:fea2:48a4', 'fe80::ec74:d7ff:fefc:58dc'] Jul 03 02:25:09.928029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:25:09.928166 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:25:09.928775 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] <== get_connector_properties: return (954ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:10.443436 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:25:10.443909 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '059f1d91-f732-47bb-9318-702568c735b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:10.444463 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:10.444981 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:10.445573 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '059f1d91-f732-47bb-9318-702568c735b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:25:10.455362 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:10.455755 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:10.455962 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:10.466266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:25:10.466266 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5] added Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:25:10.486257 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:25:11.485841 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:25:11.499742 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:25:11.501192 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:11.512145 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.529717 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.530144 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.530144 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.530144 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.530144 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.530144 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:11.580171 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5, portal: 192.168.40.100,3260] Jul 03 02:25:11.580171 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5, portal: 192.168.40.100,3260] successful. Jul 03 02:25:11.580171 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:11.593354 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 (non-flash) Jul 03 02:25:11.609195 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 (non-flash) Jul 03 02:25:11.609500 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:11.609730 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:11.609833 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:25:11.611051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] HCTL ('9', '-', '-', 0) found on session 35 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:25:11.611183 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:25:11.632385 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:25:11.632385 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '059f1d91-f732-47bb-9318-702568c735b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:25:12.635448 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.190s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:12.636312 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] <== connect_volume: return (2191ms) {'type': 'block', 'scsi_wwn': '330000000e6b5722c', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:12.636451 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:12.655077 np0000004352 sudo[118807]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:25:12.656635 np0000004352 sudo[118807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:13.016576 np0000004352 sudo[118807]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:13.018680 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.382s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:25:13.072615 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:13.079572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1527288963,backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:25:13.398121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] generate_object_name_prefix: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:25:13.405657 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] starting backup of volume: 059f1d91-f732-47bb-9318-702568c735b5, volume size: 1073741824, object names prefix volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:25:13.627195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:13.884598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:13.885077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:14.011441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:14.011630 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:14.239828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:14.496927 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:14.497032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:14.598867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:14.599053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:14.819006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:15.100314 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:15.100729 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:15.238956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:15.239143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:15.476401 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:15.744339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:15.744565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:15.852249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:15.852410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:16.063097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:16.321353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:16.321731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:16.437991 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:16.438120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:16.652211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:16.921292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:16.921292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:17.038525 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:17.040890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:17.244271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:17.501566 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:17.502084 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:17.611091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:17.611253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:17.828238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:18.082776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:18.082776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:18.202178 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:18.202392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:18.457388 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:18.742149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:18.742541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:18.860321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:18.860583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:19.090764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:19.343617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:19.343765 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:19.470294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:19.470443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:19.693150 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:19.943245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:19.943737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:20.077927 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:20.078092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:20.313087 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:20.580936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:20.580936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:20.695736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:20.695736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:20.910177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:21.171866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:21.171866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:21.296877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:21.297132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:21.585912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:21.890172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:21.890172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:22.035968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:22.036159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:22.281590 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:22.572274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:22.572402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:22.701812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:22.701812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:22.924306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:23.185226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:23.185448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:23.297557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:23.297557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:23.525876 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:23.778068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:23.778229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:23.897383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:23.897695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:24.142820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:24.405018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:24.405608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:24.525676 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:24.525947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:24.786602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:25.059996 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:25.060240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:25.171580 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:25.171766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:25.418243 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:25.721588 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:25.721829 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:25.827505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:25.827725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:25.944354 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:26.080239 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:26.080432 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:26.149196 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:26.149376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:26.165148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:25:26.171626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:25:26.171802 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:25:26.178861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:25:26.178998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:25:26.183720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:25:26.183974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1527288963, sha256file filename: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:25:26.246766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:25:26.247558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1527288963, metadata filename: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:25:26.271447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "31069b3b-dc00-4c13-b0ee-ac97e3be76de",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-803935417",\n "created_at": "2026-07-03 02:25:09+00:00",\n "objects": [\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "059f1d91-f732-47bb-9318-702568c735b5",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"059f1d91-f732-47bb-9318-702568c735b5\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"82ee902b7e5e447b81121a5ca6e883f9\\", \\"project_id\\": \\"b6e5e42911f443509ca8ff0cf5f8b69d\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:25:08.000000\\", \\"launched_at\\": \\"2026-07-03T02:25:08.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-358312452\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:25:08.000000\\", \\"updated_at\\": \\"2026-07-03T02:25:09.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:25:26.280467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] backup 31069b3b-dc00-4c13-b0ee-ac97e3be76de finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:25:26.402891 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:26.417918 np0000004352 sudo[119080]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:25:26.418602 np0000004352 sudo[119080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:26.745343 np0000004352 sudo[119080]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:26.747555 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.344s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:25:26.748099 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '059f1d91-f732-47bb-9318-702568c735b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000e6b5722c', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:26.748268 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:26.748749 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:26.749078 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '059f1d91-f732-47bb-9318-702568c735b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:26.762985 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:26.764038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:25:26.764038 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:25:26.764038 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:25:26.764038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 (non-flash) Jul 03 02:25:26.796084 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5 (non-flash) Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:26.796722 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', '35')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:25:26.797655 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5', '35')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:25:26.798007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Resulting device map defaultdict(. at 0x783584c23420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:25:26.798353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:25:26.811404 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:25:26.821432 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:25:26.872845 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:25:26.873063 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:25:26.874963 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:25:26.887277 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:25:26.888387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:25:26.902378 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:26.936733 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5, portal: 192.168.40.100,3260] Jul 03 02:25:26.936733 np0000004352 cinder-backup[101397]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-059f1d91-f732-47bb-9318-702568c735b5, portal: 192.168.40.100,3260] successful. Jul 03 02:25:26.936733 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:26.956330 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:26.956683 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.208s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:26.956914 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] <== disconnect_volume: return (208ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:27.987096 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-4d3ea6b6-f9a4-4c4d-9773-9edd12fe1b45 tempest-VolumesBackupsAdminTest-1635640033 None] Create backup finished. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de. Jul 03 02:25:28.679785 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-57f53ab5-e417-426a-a0ef-c2ed45fc639f tempest-VolumesBackupsAdminTest-550384977 None] Export record started, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de. Jul 03 02:25:28.684904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-57f53ab5-e417-426a-a0ef-c2ed45fc639f tempest-VolumesBackupsAdminTest-550384977 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_34136a367e0e43468668f69b601bc930 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:28.685044 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-57f53ab5-e417-426a-a0ef-c2ed45fc639f tempest-VolumesBackupsAdminTest-550384977 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:28.685941 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-57f53ab5-e417-426a-a0ef-c2ed45fc639f tempest-VolumesBackupsAdminTest-550384977 None] Export record finished, backup 31069b3b-dc00-4c13-b0ee-ac97e3be76de exported. Jul 03 02:25:29.287645 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-380210eb-db4e-4730-abfa-5dab2758ff6d tempest-VolumesBackupsAdminTest-550384977 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiMmNiOWQ5YTctMmM4OC00NDU5LWJlMjYtZjA2ODgyMzE0ZTA3IiwgInVzZXJfaWQiOiAiODJlZTkwMmI3ZTVlNDQ3YjgxMTIxYTVjYTZlODgzZjkiLCAicHJvamVjdF9pZCI6ICJiNmU1ZTQyOTExZjQ0MzUwOWNhOGZmMGNmNWY4YjY5ZCIsICJ2b2x1bWVfaWQiOiAiMDU5ZjFkOTEtZjczMi00N2JiLTkzMTgtNzAyNTY4YzczNWI1IiwgImhvc3QiOiAibnAwMDAwMDA0MzUyIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInRlbXBlc3Qtdm9sdW1lc2JhY2t1cHNhZG1pbnRlc3QtYmFja3VwLWNvbnRhaW5lci0xNTI3Mjg4OTYzIiwgInBhcmVudF9pZCI6IG51bGwsICJzdGF0dXMiOiAiYXZhaWxhYmxlIiwgImZhaWxfcmVhc29uIjogbnVsbCwgInNpemUiOiAxLCAiZGlzcGxheV9uYW1lIjogInRlbXBlc3QtVm9sdW1lc0JhY2t1cHNBZG1pblRlc3QtQmFja3VwLTgwMzkzNTQxNyIsICJkaXNwbGF5X2Rlc2NyaXB0aW9uIjogbnVsbCwgInNlcnZpY2VfbWV0YWRhdGEiOiAidm9sdW1lXzA1OWYxZDkxLWY3MzItNDdiYi05MzE4LTcwMjU2OGM3MzViNS8yMDI2MDcwMzAyMjUxMy9hel9ub3ZhX2JhY2t1cF8zMTA2OWIzYi1kYzAwLTRjMTMtYjBlZS1hYzk3ZTNiZTc2ZGUiLCAic2VydmljZSI6ICJjaW5kZXIuYmFja3VwLmRyaXZlcnMuc3dpZnQuU3dpZnRCYWNrdXBEcml2ZXIiLCAib2JqZWN0X2NvdW50IjogMjEsICJ0ZW1wX3ZvbHVtZV9pZCI6IG51bGwsICJ0ZW1wX3NuYXBzaG90X2lkIjogbnVsbCwgIm51bV9kZXBlbmRlbnRfYmFja3VwcyI6IDAsICJzbmFwc2hvdF9pZCI6IG51bGwsICJkYXRhX3RpbWVzdGFtcCI6ICIyMDI2LTA3LTAzVDAyOjI1OjA5WiIsICJyZXN0b3JlX3ZvbHVtZV9pZCI6IG51bGwsICJtZXRhZGF0YSI6IHt9LCAiZW5jcnlwdGlvbl9rZXlfaWQiOiBudWxsLCAiY3JlYXRlZF9hdCI6ICIyMDI2LTA3LTAzVDAyOjI1OjA5WiIsICJ1cGRhdGVkX2F0IjogIjIwMjYtMDctMDNUMDI6MjU6MjhaIiwgImRlbGV0ZWRfYXQiOiBudWxsLCAiZGVsZXRlZCI6IGZhbHNlfQ==. Jul 03 02:25:29.288813 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-380210eb-db4e-4730-abfa-5dab2758ff6d tempest-VolumesBackupsAdminTest-550384977 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_34136a367e0e43468668f69b601bc930 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:29.291004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-380210eb-db4e-4730-abfa-5dab2758ff6d tempest-VolumesBackupsAdminTest-550384977 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:29.353284 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-380210eb-db4e-4730-abfa-5dab2758ff6d tempest-VolumesBackupsAdminTest-550384977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:29.387235 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-380210eb-db4e-4730-abfa-5dab2758ff6d tempest-VolumesBackupsAdminTest-550384977 None] Import record id 2cb9d9a7-2c88-4459-be26-f06882314e07 metadata from driver finished. Jul 03 02:25:31.689700 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Restore backup started, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de volume: 572712de-5950-4825-83b4-281afcd3a4c8. Jul 03 02:25:31.703446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_b6e5e42911f443509ca8ff0cf5f8b69d {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:31.703446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:31.703446 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:31.716994 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:25:31.738754 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:31.748848 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:25:31.749266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:25:31.758274 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:25:31.759742 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe29:2001', 'fe80::f84b:8bff:fe85:9029', 'fe80::fc16:3eff:fe6e:9555', 'fe80::9894:1dff:fe25:4235', 'fe80::fc16:3eff:fec5:3c01', 'fe80::fc16:3eff:fe13:5dd6', 'fe80::fc16:3eff:fea7:3f6c', 'fe80::fc16:3eff:fe42:b902', 'fe80::fc16:3eff:fe5e:d569', 'fe80::24b8:65ff:fea0:5e6b', 'fe80::fc16:3eff:fea2:48a4', 'fe80::ec74:d7ff:fefc:58dc', 'fe80::fc16:3eff:fe01:2c19', 'fe80::fc16:3eff:fe35:38c5', 'fe80::b004:49ff:fe7b:60f8', 'fe80::fc16:3eff:fe02:82f6', 'fe80::fc16:3eff:fe3c:a9ec', 'fe80::b0d0:62ff:fe6b:330'] Jul 03 02:25:31.759850 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:25:31.759995 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:25:31.760281 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:32.768582 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:25:32.769049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '572712de-5950-4825-83b4-281afcd3a4c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:32.769362 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:32.769943 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:32.770237 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '572712de-5950-4825-83b4-281afcd3a4c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:25:32.782062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:32.783491 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:32.783491 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:32.792779 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:25:32.792779 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8] added Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:32.802972 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:32.803283 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:25:32.803823 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:25:32.804030 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:25:33.805546 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:25:33.820264 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:33.835175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.852168 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.852660 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:33.901633 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8, portal: 192.168.40.100,3260] Jul 03 02:25:33.901633 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8, portal: 192.168.40.100,3260] successful. Jul 03 02:25:33.901633 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:33.915672 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 (non-flash) Jul 03 02:25:33.931623 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a84f3a9-a27b-48dd-afb8-fee8b986ca1c (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bbf185c3-6b98-48a7-abd6-2f1a5e9fd658 (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-937ca06f-dd81-4877-83ca-8a8337028cb6 (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 (non-flash) Jul 03 02:25:33.932021 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:33.932525 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:33.932525 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:25:33.933364 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] HCTL ('9', '-', '-', 0) found on session 36 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:25:33.933639 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:25:33.947650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Searching for a device in session 36 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:25:33.947944 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '572712de-5950-4825-83b4-281afcd3a4c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:25:34.951097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:34.951489 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] <== connect_volume: return (2181ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798949', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:34.951637 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:34.978285 np0000004352 sudo[119521]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:25:34.979252 np0000004352 sudo[119521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:35.428642 np0000004352 sudo[119521]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:35.433215 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.480s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:25:35.433729 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] starting restore of backup volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de container: tempest-volumesbackupsadmintest-backup-container-1527288963, to new volume 572712de-5950-4825-83b4-281afcd3a4c8, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:25:35.433923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1527288963, metadata filename: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] _read_metadata finished. Metadata: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "backup_id": "31069b3b-dc00-4c13-b0ee-ac97e3be76de", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-803935417", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:25:09+00:00", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021": { Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: ], Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_id": "059f1d91-f732-47bb-9318-702568c735b5", Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"059f1d91-f732-47bb-9318-702568c735b5\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"82ee902b7e5e447b81121a5ca6e883f9\", \"project_id\": \"b6e5e42911f443509ca8ff0cf5f8b69d\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:25:08.000000\", \"launched_at\": \"2026-07-03T02:25:08.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-358312452\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:25:08.000000\", \"updated_at\": \"2026-07-03T02:25:09.000000\"}}" Jul 03 02:25:35.457104 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:25:35.460718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:25:35.460718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] _read_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1527288963, metadata filename: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] _read_metadata finished. Metadata: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "backup_id": "31069b3b-dc00-4c13-b0ee-ac97e3be76de", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsAdminTest-Backup-803935417", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:25:09+00:00", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021": { Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: } Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: ], Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_id": "059f1d91-f732-47bb-9318-702568c735b5", Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"059f1d91-f732-47bb-9318-702568c735b5\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"82ee902b7e5e447b81121a5ca6e883f9\", \"project_id\": \"b6e5e42911f443509ca8ff0cf5f8b69d\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:25:08.000000\", \"launched_at\": \"2026-07-03T02:25:08.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsAdminTest-Volume-358312452\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:25:08.000000\", \"updated_at\": \"2026-07-03T02:25:09.000000\"}}" Jul 03 02:25:35.474784 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:25:35.480047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] v1 volume backup restore of 31069b3b-dc00-4c13-b0ee-ac97e3be76de started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:25:35.480047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] metadata_object_names = ['volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:25:35.533476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] generated object list: ['volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:25:35.573202 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:35.577464 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:35.593295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:35.955431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:35.969804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:36.367646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:36.385134 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:36.768247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:36.790311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:37.158056 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:37.176891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:37.530964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:37.555352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:37.916390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:37.936055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:38.315036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:38.340121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:38.716228 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:38.745430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:39.137683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:39.156028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:39.531859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:39.552090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:40.008493 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:40.029121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:40.390567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:40.404518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:40.775859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:40.796948 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:41.138527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:41.158999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:41.510634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:41.528731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:41.905203 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:41.923185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:42.270626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:42.298620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:42.708635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:42.740918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:43.080396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:43.099016 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:43.431497 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restoring object. backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, object name: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021, volume: 572712de-5950-4825-83b4-281afcd3a4c8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:25:43.447248 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:25:43.607587 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] v1 volume backup restore of 31069b3b-dc00-4c13-b0ee-ac97e3be76de finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:25:43.607808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:25:43.634159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:25:43.634342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:25:43.634413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] restore 31069b3b-dc00-4c13-b0ee-ac97e3be76de to 572712de-5950-4825-83b4-281afcd3a4c8 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:25:43.634762 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:43.655163 np0000004352 sudo[120050]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:25:43.655979 np0000004352 sudo[120050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:44.031214 np0000004352 sudo[120050]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:44.033993 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.399s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:25:44.034577 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '572712de-5950-4825-83b4-281afcd3a4c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798949', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:44.034814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:44.035447 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:44.035957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '572712de-5950-4825-83b4-281afcd3a4c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:25:44.052068 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:44.052758 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:25:44.052758 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:25:44.052758 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:25:44.052758 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:25:44.082192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:44.082192 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:44.082192 np0000004352 cinder-backup[101397]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 (non-flash) Jul 03 02:25:44.082192 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8 (non-flash) Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', '36')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:25:44.083266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8', '36')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:25:44.084197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Resulting device map defaultdict(. at 0x783584bb4400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:25:44.084823 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:25:44.096834 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:25:44.107513 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:25:44.157231 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:25:44.157476 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:25:44.158644 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:25:44.168971 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:25:44.169292 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:25:44.181495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:44.216453 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8, portal: 192.168.40.100,3260] Jul 03 02:25:44.216453 np0000004352 cinder-backup[101397]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-572712de-5950-4825-83b4-281afcd3a4c8, portal: 192.168.40.100,3260] successful. Jul 03 02:25:44.216453 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:44.232640 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:44.232640 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.197s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:44.232640 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] <== disconnect_volume: return (197ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:45.249037 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Encryption key ID for volume 572712de-5950-4825-83b4-281afcd3a4c8 already matches encryption key ID in backup 31069b3b-dc00-4c13-b0ee-ac97e3be76de. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:25:45.280832 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8411f8bd-3020-4718-97aa-d9cae24c516d tempest-VolumesBackupsAdminTest-1635640033 None] Finished restoring backup 31069b3b-dc00-4c13-b0ee-ac97e3be76de to volume 572712de-5950-4825-83b4-281afcd3a4c8. Jul 03 02:25:46.260375 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Delete backup started, backup: 2cb9d9a7-2c88-4459-be26-f06882314e07. Jul 03 02:25:46.266446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_34136a367e0e43468668f69b601bc930 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:46.267090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:46.267382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] delete started, backup: 2cb9d9a7-2c88-4459-be26-f06882314e07, container: tempest-volumesbackupsadmintest-backup-container-1527288963, prefix: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:25:46.454904 np0000004352 cinder-backup[101397]: WARNING cinder.backup.chunkeddriver [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Error while listing objects, continuing with delete.: swiftclient.exceptions.ClientException: Container GET failed: https://10.4.3.223:8080/v1/AUTH_34136a367e0e43468668f69b601bc930/tempest-volumesbackupsadmintest-backup-container-1527288963?format=json&prefix=volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de 404 Not Found [first 60 chars of response] b'

Not Found

The resource could not be found.<' (txn: txb06aea189e1e4e80af18f-006a471daa) Jul 03 02:25:46.455141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] delete 2cb9d9a7-2c88-4459-be26-f06882314e07 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:25:46.486198 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:46.509559 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Created reservations ['3d31b0b8-7275-4663-b497-00ad0a07d58b', '82bbe784-7c86-48de-8294-eef3e782d5d0'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:25:46.534435 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1a4e8011-1857-454c-9bf5-2e84a06144b0 tempest-VolumesBackupsAdminTest-550384977 None] Delete backup finished, backup 2cb9d9a7-2c88-4459-be26-f06882314e07 deleted. Jul 03 02:25:47.344018 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] Delete backup started, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de. Jul 03 02:25:47.350325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_b6e5e42911f443509ca8ff0cf5f8b69d {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:47.351260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:47.351650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] delete started, backup: 31069b3b-dc00-4c13-b0ee-ac97e3be76de, container: tempest-volumesbackupsadmintest-backup-container-1527288963, prefix: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:25:47.394843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] generated object list: ['volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata', 'volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:25:47.418029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00001 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.442454 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00002 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.476939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00003 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.500347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00004 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.526450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00005 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.550966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00006 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.572978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00007 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.594873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00008 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.623362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00009 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.650868 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00010 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.678100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00011 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.709983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00012 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.733772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00013 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.775665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00014 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.802764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00015 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.835040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00016 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.871485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00017 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.906165 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00018 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.941118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00019 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:47.985271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00020 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:48.015444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de-00021 in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:48.057384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_metadata in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:48.079223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_059f1d91-f732-47bb-9318-702568c735b5/20260703022513/az_nova_backup_31069b3b-dc00-4c13-b0ee-ac97e3be76de_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1527288963. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:25:48.079546 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] delete 31069b3b-dc00-4c13-b0ee-ac97e3be76de finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:25:48.112190 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:48.140203 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] Created reservations ['9e0c01ab-bafc-4a8b-b409-8b13c3e3bdfd', '4e594eea-affc-456b-ab78-1b1ee50dbf94'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:25:48.173226 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d4c1f9d4-8bed-4b90-a477-54c49038b815 tempest-VolumesBackupsAdminTest-1635640033 None] Delete backup finished, backup 31069b3b-dc00-4c13-b0ee-ac97e3be76de deleted. Jul 03 02:25:51.019322 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Create backup started, backup: 51fd53a4-2392-4037-8f37-ace7c25c7d36 volume: 6f0b9b18-27ac-43cb-b1ca-331367db94dc. Jul 03 02:25:51.026064 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsadmintest-backup-container-1727119707',created_at=2026-07-03T02:25:50Z,data_timestamp=2026-07-03T02:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1742173025',encryption_key_id=None,fail_reason=None,host='np0000004352',id=51fd53a4-2392-4037-8f37-ace7c25c7d36,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b6e5e42911f443509ca8ff0cf5f8b69d',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='82ee902b7e5e447b81121a5ca6e883f9',volume_id=6f0b9b18-27ac-43cb-b1ca-331367db94dc) Jul 03 02:25:51.051393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_b6e5e42911f443509ca8ff0cf5f8b69d {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:25:51.051623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:25:51.052076 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:51.063991 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:25:51.090719 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:51.102095 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:25:51.102431 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:25:51.113214 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:25:51.114746 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe29:2001', 'fe80::f84b:8bff:fe85:9029', 'fe80::fc16:3eff:fe01:2c19', 'fe80::fc16:3eff:fe35:38c5', 'fe80::b004:49ff:fe7b:60f8', 'fe80::fc16:3eff:fe02:82f6', 'fe80::fc16:3eff:fe3c:a9ec', 'fe80::b0d0:62ff:fe6b:330', 'fe80::fc16:3eff:fe8e:97ef', 'fe80::2c65:e5ff:fe19:f804'] Jul 03 02:25:51.114929 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:25:51.115094 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:25:51.115466 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:51.620440 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:25:51.620970 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:25:51.621227 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:51.621893 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:51.622186 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:25:51.640042 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:25:51.640042 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:25:51.640042 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:51.648111 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:25:51.648111 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc] added Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:25:51.657755 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:51.657993 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:25:51.658844 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0206(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:25:51.658844 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:25:52.659598 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:25:52.675509 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:52.690034 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.705031 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:52.735451 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc, portal: 192.168.40.100,3260] Jul 03 02:25:52.735451 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc, portal: 192.168.40.100,3260] successful. Jul 03 02:25:52.735451 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:52.746897 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:25:52.762341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.762341 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.762341 np0000004352 cinder-backup[101397]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc (non-flash) Jul 03 02:25:52.762341 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:25:52.762543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.762543 np0000004352 cinder-backup[101397]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c5f3143c-ab98-46d8-9d6c-e18e450c21cd (non-flash) Jul 03 02:25:52.762543 np0000004352 cinder-backup[101397]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc (non-flash) Jul 03 02:25:52.762543 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:25:52.763230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:52.763230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:25:52.763801 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:25:52.763801 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:25:52.779218 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:25:53.779499 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:25:53.780044 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:25:53.780190 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.158s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:25:53.780366 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] <== connect_volume: return (2159ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798952', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:25:53.780683 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:25:53.798759 np0000004352 sudo[120317]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:25:53.799554 np0000004352 sudo[120317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:25:54.177833 np0000004352 sudo[120317]: pam_unix(sudo:session): session closed for user root Jul 03 02:25:54.183865 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.401s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:25:54.223011 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:25:54.228099 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _create_container started, container: tempest-volumesbackupsadmintest-backup-container-1727119707,backup: 51fd53a4-2392-4037-8f37-ace7c25c7d36. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:25:54.282926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] generate_object_name_prefix: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:25:54.293581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] starting backup of volume: 6f0b9b18-27ac-43cb-b1ca-331367db94dc, volume size: 1073741824, object names prefix volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:25:54.496622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:54.767292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:54.767477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:54.896340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:54.896831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:55.125752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:55.404929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:55.405050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:55.519768 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:55.520068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:55.754762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:56.021661 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:56.021661 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:56.153124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:56.153298 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:56.399971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:56.694610 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:56.694735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:56.822716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:56.822886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:57.094737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:57.389551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:57.389551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:57.514683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:57.514683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:57.726335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:58.025431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:58.025431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:58.136773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:58.137143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:58.389327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:58.653309 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:58.653511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:58.799519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:58.799670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:59.198953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:25:59.472408 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:25:59.472674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:25:59.608406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:25:59.608406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:25:59.791662 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:00.062816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:00.062940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:00.169694 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:00.169928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:00.369539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:00.609383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:00.609383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:00.735720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:00.735997 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:00.950695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:01.225531 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:01.225828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:01.346461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:01.346685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:01.543707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:01.787225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:01.787572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:01.894554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:01.894859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:02.094626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:02.373761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:02.374102 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:02.499145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:02.499145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:02.702442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:02.950392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:02.950555 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:03.059716 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:26:03.059937 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:26:03.368741 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:03.368741 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:03.717317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:03.958954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:03.959081 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:04.102470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:04.102646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:04.299240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:04.590064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:04.590206 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:04.718083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:04.718578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:04.940463 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:05.198130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:05.198627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:05.314981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:05.314981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:05.543313 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:05.806759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:05.807185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:05.923200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:05.923200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:06.159097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:06.427358 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:06.427673 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:06.540655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:06.541226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:06.542370 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=100,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:26:06.783402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:07.049730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:07.050046 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:07.174608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:07.174730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:07.277305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:26:07.412013 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:26:07.412156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:26:07.497843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup MD5 for volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:26:07.497843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:26:07.509939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:26:07.520565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:26:07.520565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:26:07.524963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:26:07.525149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:26:07.528926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:26:07.529209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _write_sha256file started, container name: tempest-volumesbackupsadmintest-backup-container-1727119707, sha256file filename: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:26:07.611831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:26:07.612459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _write_metadata started, container name: tempest-volumesbackupsadmintest-backup-container-1727119707, metadata filename: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:26:07.644473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "51fd53a4-2392-4037-8f37-ace7c25c7d36",\n "backup_name": "tempest-VolumesBackupsAdminTest-Backup-1742173025",\n "created_at": "2026-07-03 02:25:51+00:00",\n "objects": [\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6f0b9b18-27ac-43cb-b1ca-331367db94dc",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6f0b9b18-27ac-43cb-b1ca-331367db94dc\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"82ee902b7e5e447b81121a5ca6e883f9\\", \\"project_id\\": \\"b6e5e42911f443509ca8ff0cf5f8b69d\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:25:50.000000\\", \\"launched_at\\": \\"2026-07-03T02:25:50.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsAdminTest-Volume-797103502\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:25:50.000000\\", \\"updated_at\\": \\"2026-07-03T02:25:51.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:26:07.656640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] backup 51fd53a4-2392-4037-8f37-ace7c25c7d36 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:26:07.809540 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:26:07.827595 np0000004352 sudo[120983]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:26:07.828519 np0000004352 sudo[120983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:26:08.196692 np0000004352 sudo[120983]: pam_unix(sudo:session): session closed for user root Jul 03 02:26:08.199124 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.390s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:26:08.199814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798952', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:26:08.200030 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:26:08.200650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:26:08.201042 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6f0b9b18-27ac-43cb-b1ca-331367db94dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:26:08.212207 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:26:08.212821 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:26:08.212821 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:26:08.212821 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:26:08.212821 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc (non-flash) Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6 (non-flash) Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6 (non-flash) Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a (non-flash) Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a (non-flash) Jul 03 02:26:08.237983 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsi session list stdout=tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc (non-flash) Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6 (non-flash) Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6 (non-flash) Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a (non-flash) Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a (non-flash) Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77e1e353-840d-421a-a685-fc90f17c90c6', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77467952-73c9-46ef-848f-592c7377d06a', '41')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:26:08.238515 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc', '37')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:26:08.239657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Resulting device map defaultdict(. at 0x78357a4edf80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:26:08.239657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:26:08.249921 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:26:08.257860 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:26:08.311318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:26:08.311318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:26:08.311318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:26:08.324319 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:26:08.324319 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:26:08.336218 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:26:08.369698 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc, portal: 192.168.40.100,3260] Jul 03 02:26:08.369698 np0000004352 cinder-backup[101397]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-6f0b9b18-27ac-43cb-b1ca-331367db94dc, portal: 192.168.40.100,3260] successful. Jul 03 02:26:08.369698 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:26:08.385662 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:26:08.385662 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.183s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:26:08.385662 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] <== disconnect_volume: return (184ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:26:09.418639 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-47b9d720-8391-4a85-b0b6-b2eb7a7deae1 tempest-VolumesBackupsAdminTest-1635640033 None] Create backup finished. backup: 51fd53a4-2392-4037-8f37-ace7c25c7d36. Jul 03 02:26:09.739898 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b97e7687-822c-4b45-98a4-cbd667d973a7 tempest-VolumesBackupsAdminTest-550384977 None] Reset backup status started, backup_id: 51fd53a4-2392-4037-8f37-ace7c25c7d36, status: error. Jul 03 02:26:09.740173 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b97e7687-822c-4b45-98a4-cbd667d973a7 tempest-VolumesBackupsAdminTest-550384977 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 03 02:26:09.800599 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] Delete backup started, backup: 51fd53a4-2392-4037-8f37-ace7c25c7d36. Jul 03 02:26:09.806957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_b6e5e42911f443509ca8ff0cf5f8b69d {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:26:09.807195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:26:09.807520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] delete started, backup: 51fd53a4-2392-4037-8f37-ace7c25c7d36, container: tempest-volumesbackupsadmintest-backup-container-1727119707, prefix: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:26:09.855864 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] generated object list: ['volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00001', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00002', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00003', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00004', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00005', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00006', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00007', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00008', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00009', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00010', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00011', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00012', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00013', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00014', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00015', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00016', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00017', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00018', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00019', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00020', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00021', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_metadata', 'volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:26:09.886655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00001 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:09.912677 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00002 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:09.933736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00003 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:09.955510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00004 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:09.982210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00005 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.016170 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00006 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.045449 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00007 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.071089 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00008 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.099387 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00009 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.130633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00010 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.154254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00011 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.248698 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00012 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.273963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00013 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.295673 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00014 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.315347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00015 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.338878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00016 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.363250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00017 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.385624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00018 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.411508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00019 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.431381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00020 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.452672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36-00021 in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.474735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_metadata in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.495904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] deleted object: volume_6f0b9b18-27ac-43cb-b1ca-331367db94dc/20260703022554/az_nova_backup_51fd53a4-2392-4037-8f37-ace7c25c7d36_sha256file in container: tempest-volumesbackupsadmintest-backup-container-1727119707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:26:10.496123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] delete 51fd53a4-2392-4037-8f37-ace7c25c7d36 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:26:10.533186 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:26:10.553821 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] Created reservations ['6a9ef8cf-f7bd-4631-a492-cd5a162ba2b1', '2935683d-6d48-4a3c-bf84-93234381c6c6'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:26:10.598304 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3c65983a-b68a-46df-aa29-d964a09927c6 tempest-VolumesBackupsAdminTest-1635640033 None] Delete backup finished, backup 51fd53a4-2392-4037-8f37-ace7c25c7d36 deleted. Jul 03 02:26:20.593322 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:27:03.057859 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:27:03.058254 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:27:06.055508 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:27:41.306620 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: 9d268106-a76b-46c6-ba97-0ee8ca0368a8 volume: 320174e1-8560-4685-a0be-4394006de011. Jul 03 02:27:41.314616 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-981183893',created_at=2026-07-03T02:27:41Z,data_timestamp=2026-07-03T02:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1468817090',encryption_key_id=None,fail_reason=None,host='np0000004352',id=9d268106-a76b-46c6-ba97-0ee8ca0368a8,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=320174e1-8560-4685-a0be-4394006de011) Jul 03 02:27:41.454021 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:27:41.454021 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:27:41.454458 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:27:41.466410 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:27:41.493176 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:27:41.507551 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:27:41.509157 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:27:41.516758 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:27:41.518198 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::2c65:e5ff:fe19:f804', 'fe80::fc16:3eff:fe2a:7088', 'fe80::fc16:3eff:fe8e:97ef', 'fe80::fc16:3eff:fe0d:a84', 'fe80::3c0f:e6ff:fe8a:3301', 'fe80::fc16:3eff:fe3c:a9ec', 'fe80::b0d0:62ff:fe6b:330', 'fe80::fc16:3eff:fea7:bf0b', 'fe80::54b5:4bff:fee8:ebc8', 'fe80::fc16:3eff:fe47:df7d', 'fe80::480b:f5ff:fe78:2aac', 'fe80::fc16:3eff:fe37:50fb'] Jul 03 02:27:41.518352 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:27:41.518496 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:27:41.518760 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:27:42.023194 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:27:42.023648 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70902293-169d-4e3b-bb5d-8a9465d3dd31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:27:42.023835 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:27:42.024370 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:27:42.024651 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70902293-169d-4e3b-bb5d-8a9465d3dd31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:27:42.036913 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:27:42.036913 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:27:42.037208 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:27:42.047529 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:27:42.047529 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31] added Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:42.057791 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:27:42.058098 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:27:42.058355 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:27:43.059628 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:27:43.071820 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:43.081082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.093956 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.094214 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:27:43.135448 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31, portal: 192.168.40.100,3260] Jul 03 02:27:43.135448 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31, portal: 192.168.40.100,3260] successful. Jul 03 02:27:43.135448 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:43.146253 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 (non-flash) Jul 03 02:27:43.160797 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 (non-flash) Jul 03 02:27:43.161095 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:27:43.161329 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:27:43.161329 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:27:43.162062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] HCTL ('13', '-', '-', 0) found on session 58 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:27:43.162171 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:27:43.179876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 58 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:27:43.179876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70902293-169d-4e3b-bb5d-8a9465d3dd31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:27:44.181109 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.157s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:27:44.181641 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2157ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798998', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:27:44.181752 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:27:44.196760 np0000004352 sudo[125262]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:27:44.197345 np0000004352 sudo[125262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:27:44.561623 np0000004352 sudo[125262]: pam_unix(sudo:session): session closed for user root Jul 03 02:27:44.564323 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.382s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:27:44.617762 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:27:44.623242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _create_container started, container: tempest-volumesbackupstest-backup-container-981183893,backup: 9d268106-a76b-46c6-ba97-0ee8ca0368a8. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:27:44.897772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:27:44.930741 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] starting backup of volume: 320174e1-8560-4685-a0be-4394006de011, volume size: 1073741824, object names prefix volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:27:45.113478 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:45.377359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:45.380593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:45.508303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:45.508584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:45.733510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:45.974578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:45.974578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:46.078261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:46.078261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:46.288100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:46.537965 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:46.537965 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:46.660786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:46.660786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:46.904405 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:47.159038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:47.159232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:47.284190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:47.284190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:47.506596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:47.767042 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:47.767575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:47.889018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:47.889201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:48.119686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:48.385608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:48.385778 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:48.507482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:48.507634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:48.732624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:48.997759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:48.998190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:49.170665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:49.170665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:49.393198 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:49.657864 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:49.658024 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:49.851999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:49.851999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:50.060985 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:50.328365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:50.328498 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:50.470820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:50.470978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:50.681147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:50.945887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:50.946080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:51.048465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:51.048609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:51.260654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:51.535122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:51.535250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:51.638635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:51.638763 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:51.834328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:52.092109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:52.092109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:52.217622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:52.217766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:52.433651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:52.697378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:52.697588 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:52.814229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:52.814382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:53.028668 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:53.272197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:53.272346 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:53.384850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:53.385016 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:53.602553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:53.859205 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:53.859389 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:53.971586 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:53.971733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:54.189979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:54.445500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:54.445634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:54.553760 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:54.553915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:54.737386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:54.993512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:54.993733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:55.110476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:55.110476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:55.342819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:55.584443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:55.584443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:55.693795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:55.694014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:55.926329 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:56.191382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:56.191563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:56.305056 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:56.305269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:56.508370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:56.827979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:56.828143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:56.942700 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:56.943167 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:57.040194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:27:57.172068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:27:57.172310 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:27:57.234831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:27:57.235075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:27:57.243631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:27:57.251204 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:27:57.251402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:27:57.256335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:27:57.256531 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:27:57.261076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:27:57.261399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-981183893, sha256file filename: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:27:57.331368 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:27:57.332301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-981183893, metadata filename: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:27:57.360619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9d268106-a76b-46c6-ba97-0ee8ca0368a8",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1468817090",\n "created_at": "2026-07-03 02:27:41+00:00",\n "objects": [\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "320174e1-8560-4685-a0be-4394006de011",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"320174e1-8560-4685-a0be-4394006de011\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:26:32.000000\\", \\"launched_at\\": \\"2026-07-03T02:26:33.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-342990095\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:26:32.000000\\", \\"updated_at\\": \\"2026-07-03T02:27:41.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:27:57.371302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] backup 9d268106-a76b-46c6-ba97-0ee8ca0368a8 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:27:57.505602 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:27:57.523447 np0000004352 sudo[125630]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:27:57.524247 np0000004352 sudo[125630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:27:57.832925 np0000004352 sudo[125630]: pam_unix(sudo:session): session closed for user root Jul 03 02:27:57.837230 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.329s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:27:57.837230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70902293-169d-4e3b-bb5d-8a9465d3dd31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798998', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:27:57.837230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:27:57.837230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:27:57.837230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70902293-169d-4e3b-bb5d-8a9465d3dd31', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:27:57.848206 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:27:57.849719 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:27:57.849719 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:27:57.849719 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:27:57.849719 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [57] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: tcp: [58] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31 (non-flash) Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-320174e1-8560-4685-a0be-4394006de011', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', '58')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31', '58')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x783584b53420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:27:57.879197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:27:57.891702 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:27:57.900278 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:27:57.936278 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:27:57.936628 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:27:57.938071 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:27:57.949978 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:27:57.951143 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:27:57.960735 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:57.998034 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31, portal: 192.168.40.100,3260] Jul 03 02:27:57.998034 np0000004352 cinder-backup[101397]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-70902293-169d-4e3b-bb5d-8a9465d3dd31, portal: 192.168.40.100,3260] successful. Jul 03 02:27:57.998034 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:58.013739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:27:58.014136 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.178s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:27:58.014371 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (178ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:27:59.060643 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b325508a-2593-447b-93ed-848e48a8c17a tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: 9d268106-a76b-46c6-ba97-0ee8ca0368a8. Jul 03 02:27:59.771450 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: 9d268106-a76b-46c6-ba97-0ee8ca0368a8. Jul 03 02:27:59.781818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:27:59.782134 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:27:59.782446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] delete started, backup: 9d268106-a76b-46c6-ba97-0ee8ca0368a8, container: tempest-volumesbackupstest-backup-container-981183893, prefix: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:27:59.829719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00001', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00002', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00003', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00004', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00005', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00006', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00007', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00008', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00009', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00010', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00011', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00012', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00013', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00014', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00015', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00016', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00017', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00018', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00019', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00020', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00021', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_metadata', 'volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:27:59.848856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00001 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.870852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00002 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.893251 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00003 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.913108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00004 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.939481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00005 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.969409 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00006 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:27:59.996105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00007 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.017353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00008 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.041032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00009 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.061334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00010 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.083275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00011 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.106920 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00012 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.131318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00013 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.153536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00014 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.183340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00015 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.205098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00016 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.237879 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00017 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.263119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00018 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.289235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00019 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.312385 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00020 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.345276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8-00021 in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.392670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_metadata in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.426299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_320174e1-8560-4685-a0be-4394006de011/20260703022744/az_nova_backup_9d268106-a76b-46c6-ba97-0ee8ca0368a8_sha256file in container: tempest-volumesbackupstest-backup-container-981183893. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:00.426537 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] delete 9d268106-a76b-46c6-ba97-0ee8ca0368a8 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:28:00.465498 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:28:00.484589 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] Created reservations ['4050c034-f5d9-43d9-b4fd-2fe6aeaa1825', '04883c84-8c29-465d-a89f-5b47e4c68fce'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:28:00.505078 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2d42c48b-2688-40d3-803b-ee44ab58dd07 tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup 9d268106-a76b-46c6-ba97-0ee8ca0368a8 deleted. Jul 03 02:28:03.062804 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:28:03.062804 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:28:10.500217 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:28:14.633611 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa volume: 4d630ed3-9ef9-4cee-9181-370075bc7270. Jul 03 02:28:14.642674 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1499391366',created_at=2026-07-03T02:28:14Z,data_timestamp=2026-07-03T02:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-972907222',encryption_key_id=None,fail_reason=None,host='np0000004352',id=cdc9e69c-9227-42ec-9533-b0ec7d6c05aa,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=4d630ed3-9ef9-4cee-9181-370075bc7270) Jul 03 02:28:14.662065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:28:14.662243 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:28:14.662516 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:14.671570 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:28:14.687474 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:14.697232 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:28:14.697532 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:28:14.705822 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:28:14.707311 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::2c65:e5ff:fe19:f804', 'fe80::fc16:3eff:fe2a:7088', 'fe80::fc16:3eff:fe8e:97ef', 'fe80::fc16:3eff:fea7:bf0b', 'fe80::54b5:4bff:fee8:ebc8', 'fe80::fc16:3eff:fe47:df7d', 'fe80::480b:f5ff:fe78:2aac', 'fe80::fc16:3eff:fe77:4c5f', 'fe80::70d5:31ff:fe6c:72e1', 'fe80::fc16:3eff:fe37:50fb', 'fe80::fc16:3eff:fe40:ff7c', 'fe80::e46b:14ff:fedd:6ff5'] Jul 03 02:28:14.707311 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:28:14.707462 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:28:14.707747 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (44ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:15.212737 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:28:15.212737 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d630ed3-9ef9-4cee-9181-370075bc7270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:15.212737 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:16.880880 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.668s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:16.880880 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d630ed3-9ef9-4cee-9181-370075bc7270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:28:16.892058 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:16.892443 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:16.892635 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:16.901405 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:28:16.901405 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270] added Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0199(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:28:16.913975 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:28:17.913934 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:28:17.927199 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:17.939773 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:17.954594 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:17.954958 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:18.006066 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270, portal: 192.168.40.100,3260] Jul 03 02:28:18.006066 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270, portal: 192.168.40.100,3260] successful. Jul 03 02:28:18.006066 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:18.017597 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 (non-flash) Jul 03 02:28:18.032051 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-368db67d-b0f0-4da1-9306-2d5b3e5e7ede (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bad14176-2553-4c44-8b14-1da54777e5bb (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-df10c892-fd67-4618-8ef1-49c604553730 (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 (non-flash) Jul 03 02:28:18.032449 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:18.032658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:18.032882 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:28:18.033953 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] HCTL ('13', '-', '-', 0) found on session 61 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:28:18.034136 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:28:18.047756 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 61 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:28:18.047756 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d630ed3-9ef9-4cee-9181-370075bc7270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:28:19.052548 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.172s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:19.052998 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (3841ms) {'type': 'block', 'scsi_wwn': '33000000045771467', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:19.053491 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:19.069803 np0000004352 sudo[126543]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:28:19.070427 np0000004352 sudo[126543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:28:19.445624 np0000004352 sudo[126543]: pam_unix(sudo:session): session closed for user root Jul 03 02:28:19.447773 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.394s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:28:19.492977 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:28:19.501242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1499391366,backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:28:19.552973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:28:19.558468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] starting backup of volume: 4d630ed3-9ef9-4cee-9181-370075bc7270, volume size: 1073741824, object names prefix volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:28:19.782186 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:20.514617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:20.515059 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:20.787211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:20.787402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:20.978640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:21.222441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:21.222679 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:21.361787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:21.362042 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:21.547208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:21.851432 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:21.851613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:21.984750 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003: a35891500449df17e893f84bd88472fb {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:21.984918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:22.208276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:22.463488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:22.463631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:22.574851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:22.575180 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:22.760718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:23.009976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:23.010135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:23.133315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:23.133494 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:23.365000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:23.642308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:23.642882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:23.755563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:23.755781 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:23.945502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:24.190278 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:24.190392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:24.294530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:24.294712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:24.473225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:24.722167 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:24.722544 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:24.827027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:24.827222 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:25.011993 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:25.266407 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:25.266570 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:25.396105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:25.396290 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:25.611411 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:25.856665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:25.857076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:25.975816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:25.975990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:26.201582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:26.457343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:26.457539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:26.575775 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:26.575937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:26.776718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:27.025353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:27.025754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:27.136733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:27.136733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:27.338376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:27.612106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:27.612240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:27.712120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:27.712286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:27.944771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:28.194702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:28.195123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:28.304585 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:28.304793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:28.517630 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:28.785606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:28.785823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:28.892202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:28.892453 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:29.104847 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:29.356287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:29.356629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:29.464025 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:29.464155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:29.688629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:29.937873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:29.938032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:30.041344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:30.041574 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:30.269432 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:30.533770 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:30.533770 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:30.643740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:30.643740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:30.884007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:31.143572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:31.143773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:31.247702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:31.247876 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:31.500960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:31.762416 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:31.762801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:31.878748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:31.878903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:31.972882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:32.105356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:32.105529 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:32.175205 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:32.175355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:32.182197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:28:32.187718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:28:32.187876 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:28:32.191684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:28:32.191856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:28:32.195181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 02:28:32.195390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1499391366, sha256file filename: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:28:32.255450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:28:32.256292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1499391366, metadata filename: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:28:32.279050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "cdc9e69c-9227-42ec-9533-b0ec7d6c05aa",\n "backup_name": "tempest-VolumesBackupsTest-Backup-972907222",\n "created_at": "2026-07-03 02:28:15+00:00",\n "objects": [\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "4d630ed3-9ef9-4cee-9181-370075bc7270",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"4d630ed3-9ef9-4cee-9181-370075bc7270\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:28:13.000000\\", \\"launched_at\\": \\"2026-07-03T02:28:14.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-254261187\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:28:13.000000\\", \\"updated_at\\": \\"2026-07-03T02:28:15.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"ea993fc3-c724-45f7-8dae-63cf2cac16e5\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:28:32.284616 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] backup cdc9e69c-9227-42ec-9533-b0ec7d6c05aa finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:28:32.418860 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:32.434064 np0000004352 sudo[126949]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:28:32.434723 np0000004352 sudo[126949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:28:32.791368 np0000004352 sudo[126949]: pam_unix(sudo:session): session closed for user root Jul 03 02:28:32.793536 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.375s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:28:32.794084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d630ed3-9ef9-4cee-9181-370075bc7270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000045771467', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:32.794306 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:34.353270 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.559s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:34.353804 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d630ed3-9ef9-4cee-9181-370075bc7270', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:34.368209 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:34.368888 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:28:34.368888 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:28:34.368888 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:28:34.368888 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:28:34.392825 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 (non-flash) Jul 03 02:28:34.392825 np0000004352 cinder-backup[101397]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:34.392825 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:34.392825 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:34.393012 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270 (non-flash) Jul 03 02:28:34.393012 np0000004352 cinder-backup[101397]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:34.393012 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:34.393012 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:34.393012 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829', '63')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:28:34.393158 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270', '61')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:28:34.393991 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x783584bb4a40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:28:34.394219 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:28:34.404320 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:28:34.412643 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:28:34.473117 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:28:34.473478 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:28:34.474285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:28:34.485736 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:28:34.486016 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:28:34.497685 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:34.526980 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270, portal: 192.168.40.100,3260] Jul 03 02:28:34.526980 np0000004352 cinder-backup[101397]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-4d630ed3-9ef9-4cee-9181-370075bc7270, portal: 192.168.40.100,3260] successful. Jul 03 02:28:34.526980 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:34.540811 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:34.541100 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.188s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:34.541309 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (1746ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:35.569316 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-bbbd3ffd-2b04-4e6f-a009-70023dd70461 tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. Jul 03 02:28:37.439534 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Restore backup started, backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa volume: 63080e27-9d12-4b12-9e3c-88c62488e620. Jul 03 02:28:37.450064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:28:37.450250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:28:37.450603 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:37.461168 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:28:37.485161 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:37.495444 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:28:37.495739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:28:37.503654 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:28:37.504961 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::2c65:e5ff:fe19:f804', 'fe80::fc16:3eff:fe2a:7088', 'fe80::fc16:3eff:fe8e:97ef', 'fe80::fc16:3eff:fea7:bf0b', 'fe80::54b5:4bff:fee8:ebc8', 'fe80::fc16:3eff:fe77:4c5f', 'fe80::70d5:31ff:fe6c:72e1', 'fe80::fc16:3eff:fe40:ff7c', 'fe80::e46b:14ff:fedd:6ff5', 'fe80::fc16:3eff:fe2b:95f2', 'fe80::b0d0:62ff:fe6b:330', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e'] Jul 03 02:28:37.505073 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:28:37.505227 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:28:37.505613 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:38.511880 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:28:38.512321 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63080e27-9d12-4b12-9e3c-88c62488e620', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:38.512632 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:38.513197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:38.513521 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63080e27-9d12-4b12-9e3c-88c62488e620', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:28:38.525302 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:38.525863 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:38.525930 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:38.536896 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:28:38.536896 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620] added Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:38.546387 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:38.546693 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:28:38.546940 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:28:38.547121 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:28:39.548491 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:28:39.558292 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:39.569879 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:39.582937 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.582937 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.582937 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:39.583093 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.583093 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.583093 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:39.610813 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620, portal: 192.168.40.100,3260] Jul 03 02:28:39.610813 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620, portal: 192.168.40.100,3260] successful. Jul 03 02:28:39.610813 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:39.622243 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:39.637404 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.637404 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.637404 np0000004352 cinder-backup[101397]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 (non-flash) Jul 03 02:28:39.637404 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:39.637650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.637650 np0000004352 cinder-backup[101397]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c7e055-de94-423f-917c-e317eb177829 (non-flash) Jul 03 02:28:39.637650 np0000004352 cinder-backup[101397]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 (non-flash) Jul 03 02:28:39.637650 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:39.638064 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.112s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:39.638145 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:28:39.638820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] HCTL ('9', '-', '-', 0) found on session 64 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:28:39.638978 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:28:39.651896 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 64 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:28:39.652126 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63080e27-9d12-4b12-9e3c-88c62488e620', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:28:40.654439 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.141s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:40.654832 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2141ms) {'type': 'block', 'scsi_wwn': '3300000007465ce5e', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:40.655080 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:40.672162 np0000004352 sudo[127328]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:28:40.672886 np0000004352 sudo[127328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:28:40.999103 np0000004352 sudo[127328]: pam_unix(sudo:session): session closed for user root Jul 03 02:28:41.001548 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.346s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:28:41.002120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] starting restore of backup volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa container: tempest-volumesbackupstest-backup-container-1499391366, to new volume 63080e27-9d12-4b12-9e3c-88c62488e620, backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:28:41.002337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1499391366, metadata filename: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] _read_metadata finished. Metadata: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "backup_id": "cdc9e69c-9227-42ec-9533-b0ec7d6c05aa", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-972907222", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:28:15+00:00", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021": { Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: ], Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_id": "4d630ed3-9ef9-4cee-9181-370075bc7270", Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4d630ed3-9ef9-4cee-9181-370075bc7270\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"7fb70befd1dd4bae81103733bda1dd6c\", \"project_id\": \"7de1b81420d7488f991695d2bc1f15a7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:28:13.000000\", \"launched_at\": \"2026-07-03T02:28:14.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-254261187\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:28:13.000000\", \"updated_at\": \"2026-07-03T02:28:15.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"ea993fc3-c724-45f7-8dae-63cf2cac16e5\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 02:28:41.026020 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:28:41.031663 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:28:41.031663 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-1499391366, metadata filename: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] _read_metadata finished. Metadata: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "backup_id": "cdc9e69c-9227-42ec-9533-b0ec7d6c05aa", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-972907222", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:28:15+00:00", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021": { Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: } Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: ], Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_id": "4d630ed3-9ef9-4cee-9181-370075bc7270", Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"4d630ed3-9ef9-4cee-9181-370075bc7270\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"7fb70befd1dd4bae81103733bda1dd6c\", \"project_id\": \"7de1b81420d7488f991695d2bc1f15a7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:28:13.000000\", \"launched_at\": \"2026-07-03T02:28:14.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-254261187\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:28:13.000000\", \"updated_at\": \"2026-07-03T02:28:15.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"ea993fc3-c724-45f7-8dae-63cf2cac16e5\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 02:28:41.041396 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:28:41.045774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] v1 volume backup restore of cdc9e69c-9227-42ec-9533-b0ec7d6c05aa started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:28:41.045774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] metadata_object_names = ['volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:28:41.096487 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:28:41.140983 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:28:41.145484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:41.252039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:41.739486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:41.759061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:42.110979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:42.131327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:42.482142 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:42.498547 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:42.843374 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:42.858018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:43.198269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:43.212518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:43.552274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:43.567368 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:43.925123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:43.942484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:44.282350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:44.304106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:44.644520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:44.679743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:45.018029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:45.041396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:45.370916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:45.383478 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:45.739379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:45.756655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:46.116146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:46.148788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:46.500915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:46.521380 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:46.847569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:46.863974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:47.222594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:47.246706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:47.597172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:47.613795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:47.981168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:47.996613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:48.321658 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:48.344244 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:48.690785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restoring object. backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, object name: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021, volume: 63080e27-9d12-4b12-9e3c-88c62488e620. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:28:48.714032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:28:48.884191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] v1 volume backup restore of cdc9e69c-9227-42ec-9533-b0ec7d6c05aa finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:28:48.884406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:28:48.894160 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:28:48.894339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Restoring volume glance metadata {{(pid=101397) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 03 02:28:48.984090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] restore cdc9e69c-9227-42ec-9533-b0ec7d6c05aa to 63080e27-9d12-4b12-9e3c-88c62488e620 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:28:48.991465 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:49.006831 np0000004352 sudo[127724]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:28:49.007585 np0000004352 sudo[127724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:28:49.322511 np0000004352 sudo[127724]: pam_unix(sudo:session): session closed for user root Jul 03 02:28:49.324956 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.333s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:28:49.325599 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63080e27-9d12-4b12-9e3c-88c62488e620', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000007465ce5e', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:49.325791 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:49.326285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:49.326727 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63080e27-9d12-4b12-9e3c-88c62488e620', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:28:49.336374 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:49.336792 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:28:49.336792 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:28:49.336792 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:28:49.337036 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:28:49.359725 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 (non-flash) Jul 03 02:28:49.359725 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:49.360138 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620 (non-flash) Jul 03 02:28:49.360138 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:49.360435 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', '64')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:28:49.360910 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620', '64')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:28:49.362900 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x783584c03380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:28:49.363140 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:28:49.375132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:28:49.389773 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:28:49.433241 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:28:49.433458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:28:49.434239 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:28:49.444318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:28:49.444606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:28:49.456834 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:49.494287 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620, portal: 192.168.40.100,3260] Jul 03 02:28:49.494287 np0000004352 cinder-backup[101397]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-63080e27-9d12-4b12-9e3c-88c62488e620, portal: 192.168.40.100,3260] successful. Jul 03 02:28:49.494287 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:49.504592 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:49.504870 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.179s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:49.505059 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (179ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:50.529156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Encryption key ID for volume 63080e27-9d12-4b12-9e3c-88c62488e620 already matches encryption key ID in backup cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:28:50.559646 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b1ead453-9425-4690-b60c-3d8197fba0df tempest-VolumesBackupsTest-91322192 None] Finished restoring backup cdc9e69c-9227-42ec-9533-b0ec7d6c05aa to volume 63080e27-9d12-4b12-9e3c-88c62488e620. Jul 03 02:28:52.008398 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. Jul 03 02:28:52.015660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:28:52.015858 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:28:52.016368 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] delete started, backup: cdc9e69c-9227-42ec-9533-b0ec7d6c05aa, container: tempest-volumesbackupstest-backup-container-1499391366, prefix: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:28:52.051752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata', 'volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:28:52.076186 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00001 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.099310 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00002 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.123594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00003 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.147714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00004 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.175713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00005 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.201355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00006 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.226014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00007 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.250485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00008 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.279111 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00009 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.311960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00010 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.340244 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00011 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.368145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00012 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.387707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00013 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.419483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00014 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.438409 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00015 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.456325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00016 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.483583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00017 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.508437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00018 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.539487 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00019 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.564832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00020 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.598032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa-00021 in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.626357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_metadata in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.650635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_4d630ed3-9ef9-4cee-9181-370075bc7270/20260703022819/az_nova_backup_cdc9e69c-9227-42ec-9533-b0ec7d6c05aa_sha256file in container: tempest-volumesbackupstest-backup-container-1499391366. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:28:52.650635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] delete cdc9e69c-9227-42ec-9533-b0ec7d6c05aa finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:28:52.691303 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:28:52.709527 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] Created reservations ['f31e2fe3-f66e-4d0a-8ff1-eddb226ca0d5', '9db47763-21a0-4fa4-983e-57033adf6153'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:28:52.725234 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6ca3cebd-ae47-43db-9c65-73043ecea215 tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup cdc9e69c-9227-42ec-9533-b0ec7d6c05aa deleted. Jul 03 02:28:55.724447 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e volume: a95497d4-e915-4cc5-8cae-a249a55bf201. Jul 03 02:28:55.733406 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-507637182',created_at=2026-07-03T02:28:55Z,data_timestamp=2026-07-03T02:28:55Z,deleted=False,deleted_at=None,display_description='tempest-backup-description-687348054',display_name='tempest-VolumesBackupsTest-Backup-1914076220',encryption_key_id=None,fail_reason=None,host='np0000004352',id=1e68222b-ac10-4ee4-a8d7-2389b6c7872e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=a95497d4-e915-4cc5-8cae-a249a55bf201) Jul 03 02:28:55.771842 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:28:55.771842 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:28:55.772335 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:55.786553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:28:55.809114 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:55.820006 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:28:55.820347 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:28:55.828880 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:28:55.831628 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fea7:bf0b', 'fe80::54b5:4bff:fee8:ebc8', 'fe80::fc16:3eff:fe2b:95f2', 'fe80::b0d0:62ff:fe6b:330', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e', 'fe80::fc16:3eff:fec8:34de', 'fe80::68c3:2ff:fe81:dcc0', 'fe80::fc16:3eff:fe8f:e6a3'] Jul 03 02:28:55.832355 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:28:55.832596 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:28:55.832999 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:56.091574 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-13062abe-6203-4807-92f5-5bd2a9e020ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:28:56.337925 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:28:56.338414 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a95497d4-e915-4cc5-8cae-a249a55bf201', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:28:56.338653 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:56.339167 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:56.339697 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a95497d4-e915-4cc5-8cae-a249a55bf201', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:28:56.359724 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:28:56.360296 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:28:56.360296 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:56.377257 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:28:56.377257 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201] added Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:28:56.395175 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:56.395461 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:28:56.395905 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:28:56.396157 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:28:57.397711 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:28:57.407076 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:57.416985 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:57.427657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:28:57.427657 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:57.427802 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:28:57.427802 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:57.427940 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:28:57.427940 np0000004352 cinder-backup[101397]: Jul 03 02:28:57.463028 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201, portal: 192.168.40.100,3260] Jul 03 02:28:57.463028 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201, portal: 192.168.40.100,3260] successful. Jul 03 02:28:57.463028 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:57.474202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:28:57.485629 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 (non-flash) Jul 03 02:28:57.485629 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:28:57.485806 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 (non-flash) Jul 03 02:28:57.485806 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:28:57.486075 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:57.486191 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:28:57.486677 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] HCTL ('7', '-', '-', 0) found on session 65 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:28:57.486790 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:28:57.501561 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 65 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:28:57.501882 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a95497d4-e915-4cc5-8cae-a249a55bf201', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:28:58.504718 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.165s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:28:58.505056 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2166ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799008', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:28:58.505316 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:28:58.524404 np0000004352 sudo[128000]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:28:58.525194 np0000004352 sudo[128000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:28:58.874402 np0000004352 sudo[128000]: pam_unix(sudo:session): session closed for user root Jul 03 02:28:58.876535 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.371s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:28:58.884236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _create_container started, container: tempest-volumesbackupstest-backup-container-507637182,backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:28:58.942736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:28:58.947353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] starting backup of volume: a95497d4-e915-4cc5-8cae-a249a55bf201, volume size: 1073741824, object names prefix volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:28:59.140049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:59.399691 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:59.399851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:28:59.514996 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:28:59.515407 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:28:59.702578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:28:59.993527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:28:59.993653 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:00.107838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:00.108009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:00.302365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:00.545983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:00.546361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:00.673169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:00.673398 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:00.886138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:01.146325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:01.146525 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:01.249570 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:01.249727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:01.448029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:01.734260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:01.734765 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:01.863077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:01.863077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:02.082789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:02.336838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:02.337098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:02.458232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:02.458620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:02.697860 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:02.951441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:02.952001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:03.084963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:03.084963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:03.311704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:03.579108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:03.579263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:03.700602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:03.700926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:03.901440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:04.171765 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:04.172253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:04.299085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:04.299248 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:04.502791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:04.761742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:04.761880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:04.896966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:04.897115 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:05.104158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:05.398103 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:05.398610 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:05.504448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:05.504697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:05.700125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:05.949490 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:05.949595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:06.060732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:06.060839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:06.296664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:06.551824 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:06.552503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:06.680100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:06.680296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:06.890388 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:07.162239 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:07.162470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:07.278384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:07.278633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:07.467960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:07.762791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:07.763335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:07.884141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:07.887867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:08.126400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:08.395337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:08.395533 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:08.497372 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:08.497554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:08.684818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:08.931335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:08.931731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:09.029563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:09.029835 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:09.222542 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:09.473327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:09.473535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:09.596356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:09.596356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:09.775390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:10.047283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:10.047748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:10.226066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:10.226232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:10.467359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:10.740080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:10.740221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:10.847875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:10.848090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:10.850113 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=119,cinder:UPDATE=19,cinder:INSERT=17 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:29:10.945813 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:29:11.075156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:29:11.075536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:29:11.146052 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:29:11.146177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:29:11.153556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:29:11.161328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:29:11.161488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:29:11.167138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:121}} Jul 03 02:29:11.167462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:29:11.170749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:29:11.171016 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-507637182, sha256file filename: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:29:11.236505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:29:11.237316 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-507637182, metadata filename: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:29:11.265153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": "tempest-backup-description-687348054",\n "backup_id": "1e68222b-ac10-4ee4-a8d7-2389b6c7872e",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1914076220",\n "created_at": "2026-07-03 02:28:56+00:00",\n "objects": [\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a95497d4-e915-4cc5-8cae-a249a55bf201",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a95497d4-e915-4cc5-8cae-a249a55bf201\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:28:55.000000\\", \\"launched_at\\": \\"2026-07-03T02:28:55.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-148042985\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:28:54.000000\\", \\"updated_at\\": \\"2026-07-03T02:28:56.000000\\"}, \\"volume-metadata\\": {\\"vol-meta1\\": \\"value1\\", \\"vol-meta2\\": \\"value2\\", \\"vol-meta3\\": \\"value3\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:29:11.277931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] backup 1e68222b-ac10-4ee4-a8d7-2389b6c7872e finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:29:11.419354 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:29:11.433436 np0000004352 sudo[128681]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:29:11.434022 np0000004352 sudo[128681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:29:11.748596 np0000004352 sudo[128681]: pam_unix(sudo:session): session closed for user root Jul 03 02:29:11.750573 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.331s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:29:11.751213 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a95497d4-e915-4cc5-8cae-a249a55bf201', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799008', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:29:11.751412 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:29:11.751930 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:29:11.752341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a95497d4-e915-4cc5-8cae-a249a55bf201', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:11.763411 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:11.764164 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:29:11.764164 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:29:11.764164 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:29:11.764164 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 (non-flash) Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:11.785764 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201 (non-flash) Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:29:11.786051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170', '69')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:29:11.786252 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201', '65')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:29:11.787071 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x78357a4ef420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:29:11.787323 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:29:11.799975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:29:11.808191 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:29:11.851145 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:29:11.851350 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:29:11.852649 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:29:11.863136 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:29:11.863410 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:29:11.873650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:11.900886 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201, portal: 192.168.40.100,3260] Jul 03 02:29:11.900886 np0000004352 cinder-backup[101397]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-a95497d4-e915-4cc5-8cae-a249a55bf201, portal: 192.168.40.100,3260] successful. Jul 03 02:29:11.900886 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:11.917613 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:11.917866 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.166s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:29:11.918038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (166ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:29:12.953776 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5e834dce-8b0e-4c9b-8e87-c08a11aa89c1 tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e. Jul 03 02:29:14.461662 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Restore backup started, backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e volume: 78748af2-5a46-4595-bcfb-0440beea99a7. Jul 03 02:29:14.473311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:29:14.473481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:29:14.473955 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:29:14.485226 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:29:14.508677 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:29:14.518744 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:29:14.519052 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:29:14.528182 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:29:14.529975 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fea7:bf0b', 'fe80::54b5:4bff:fee8:ebc8', 'fe80::fc16:3eff:fe2b:95f2', 'fe80::b0d0:62ff:fe6b:330', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e', 'fe80::fc16:3eff:fec8:34de', 'fe80::68c3:2ff:fe81:dcc0', 'fe80::fc16:3eff:fe8f:e6a3', 'fe80::fc16:3eff:feb7:c9c9', 'fe80::fc16:3eff:fe3d:4d18', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:29:14.530193 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:29:14.530352 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:29:14.530814 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:29:15.539091 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:29:15.539572 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78748af2-5a46-4595-bcfb-0440beea99a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:29:15.539747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:29:15.540218 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:29:15.540412 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78748af2-5a46-4595-bcfb-0440beea99a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:29:15.553163 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:29:15.553724 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:29:15.554024 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:29:15.565137 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:29:15.565137 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7] added Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:29:15.576553 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:29:15.576995 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:29:16.577740 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:29:16.586829 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:16.596161 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:16.609624 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.609624 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.609624 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.609624 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.609624 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:16.609788 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.609788 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.609788 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.609788 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.609788 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:29:16.641483 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7, portal: 192.168.40.100,3260] Jul 03 02:29:16.641483 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7, portal: 192.168.40.100,3260] successful. Jul 03 02:29:16.641483 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:16.653160 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 (non-flash) Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] HCTL ('7', '-', '-', 0) found on session 70 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:29:16.669387 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:29:16.689157 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 70 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:29:16.689157 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78748af2-5a46-4595-bcfb-0440beea99a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:29:17.691327 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:29:17.691717 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2151ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799013', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:29:17.691773 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:29:17.712698 np0000004352 sudo[128941]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:29:17.714841 np0000004352 sudo[128941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:29:18.005600 np0000004352 sudo[128941]: pam_unix(sudo:session): session closed for user root Jul 03 02:29:18.007815 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.315s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:29:18.008338 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] starting restore of backup volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e container: tempest-volumesbackupstest-backup-container-507637182, to new volume 78748af2-5a46-4595-bcfb-0440beea99a7, backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:29:18.008550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-507637182, metadata filename: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] _read_metadata finished. Metadata: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "backup_description": "tempest-backup-description-687348054", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "backup_id": "1e68222b-ac10-4ee4-a8d7-2389b6c7872e", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1914076220", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:28:56+00:00", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021": { Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: ], Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_id": "a95497d4-e915-4cc5-8cae-a249a55bf201", Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a95497d4-e915-4cc5-8cae-a249a55bf201\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"7fb70befd1dd4bae81103733bda1dd6c\", \"project_id\": \"7de1b81420d7488f991695d2bc1f15a7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:28:55.000000\", \"launched_at\": \"2026-07-03T02:28:55.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-148042985\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:28:54.000000\", \"updated_at\": \"2026-07-03T02:28:56.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 03 02:29:18.032718 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:29:18.036046 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:29:18.036046 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] _read_metadata started, container name: tempest-volumesbackupstest-backup-container-507637182, metadata filename: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] _read_metadata finished. Metadata: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "backup_description": "tempest-backup-description-687348054", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "backup_id": "1e68222b-ac10-4ee4-a8d7-2389b6c7872e", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1914076220", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:28:56+00:00", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021": { Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: } Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: ], Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_id": "a95497d4-e915-4cc5-8cae-a249a55bf201", Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a95497d4-e915-4cc5-8cae-a249a55bf201\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"7fb70befd1dd4bae81103733bda1dd6c\", \"project_id\": \"7de1b81420d7488f991695d2bc1f15a7\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:28:55.000000\", \"launched_at\": \"2026-07-03T02:28:55.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-148042985\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:28:54.000000\", \"updated_at\": \"2026-07-03T02:28:56.000000\"}, \"volume-metadata\": {\"vol-meta1\": \"value1\", \"vol-meta2\": \"value2\", \"vol-meta3\": \"value3\"}}" Jul 03 02:29:18.059581 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:29:18.063257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] v1 volume backup restore of 1e68222b-ac10-4ee4-a8d7-2389b6c7872e started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:29:18.063257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] metadata_object_names = ['volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:29:18.110673 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:29:18.142045 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:29:18.146015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:18.158391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:18.504743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:18.523327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:18.904995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:18.926604 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:19.291697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:19.310033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:19.641613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:19.661927 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:19.989821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:20.013137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:20.403695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:20.420053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:20.814650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:20.834944 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:21.173195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:21.191866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:21.522856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:21.538500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:21.863047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:21.877402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:22.212841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:22.231383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:22.628693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:22.642942 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:22.974397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:22.990225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:23.330713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:23.344972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:23.693627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:23.708200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:24.030112 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:24.044617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:24.406738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:24.422433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:24.783912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:24.802092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:25.132569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:25.146477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:25.536412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restoring object. backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, object name: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021, volume: 78748af2-5a46-4595-bcfb-0440beea99a7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:29:25.554695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:29:25.720124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] v1 volume backup restore of 1e68222b-ac10-4ee4-a8d7-2389b6c7872e finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:29:25.720387 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:29:25.735054 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Restoring volume metadata {{(pid=101397) _restore_vol_meta /opt/stack/cinder/cinder/backup/driver.py:249}} Jul 03 02:29:25.744145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:29:25.744277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] restore 1e68222b-ac10-4ee4-a8d7-2389b6c7872e to 78748af2-5a46-4595-bcfb-0440beea99a7 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:29:25.744736 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:29:25.760455 np0000004352 sudo[129358]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:29:25.761072 np0000004352 sudo[129358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:29:26.062753 np0000004352 sudo[129358]: pam_unix(sudo:session): session closed for user root Jul 03 02:29:26.065851 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.320s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:29:26.065851 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78748af2-5a46-4595-bcfb-0440beea99a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799013', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:29:26.065851 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:29:26.127772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.061s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:29:26.127772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '78748af2-5a46-4595-bcfb-0440beea99a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:29:26.145082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03 (non-flash) Jul 03 02:29:26.179959 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03 (non-flash) Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31a6ca9-d106-4fcf-8884-75ee2f381170', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38df2ea7-162f-4987-94bb-fe22135d2d46', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03', '73'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f8ecbd41-5efe-401b-af85-1dc8a187fa03', '74')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:29:26.180503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7', '70')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:29:26.181539 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x78357a536700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:29:26.181750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:29:26.194965 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:29:26.202263 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:29:26.245920 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:29:26.246080 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:29:26.247095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:29:26.259178 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:29:26.259529 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:29:26.272315 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:26.306668 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7, portal: 192.168.40.100,3260] Jul 03 02:29:26.306668 np0000004352 cinder-backup[101397]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-78748af2-5a46-4595-bcfb-0440beea99a7, portal: 192.168.40.100,3260] successful. Jul 03 02:29:26.306668 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:26.321942 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:29:26.322195 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:29:26.322342 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (256ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:29:27.335986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Encryption key ID for volume 78748af2-5a46-4595-bcfb-0440beea99a7 already matches encryption key ID in backup 1e68222b-ac10-4ee4-a8d7-2389b6c7872e. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:29:27.359439 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-be0b532e-2029-4e69-b156-a8be8afa75fe tempest-VolumesBackupsTest-91322192 None] Finished restoring backup 1e68222b-ac10-4ee4-a8d7-2389b6c7872e to volume 78748af2-5a46-4595-bcfb-0440beea99a7. Jul 03 02:29:29.050237 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e. Jul 03 02:29:29.055383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:29:29.055654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:29:29.055902 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] delete started, backup: 1e68222b-ac10-4ee4-a8d7-2389b6c7872e, container: tempest-volumesbackupstest-backup-container-507637182, prefix: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:29:29.100669 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata', 'volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:29:29.120579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00001 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.141469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00002 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.166323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00003 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.188764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00004 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.209101 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00005 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.230628 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00006 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.253204 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00007 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.278092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00008 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.297889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00009 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.317776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00010 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.341223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00011 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.373389 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00012 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.404485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00013 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.426500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00014 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.445467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00015 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.466804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00016 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.487867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00017 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.509223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00018 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.532720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00019 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.555408 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00020 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.575882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e-00021 in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.594782 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_metadata in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.613593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] deleted object: volume_a95497d4-e915-4cc5-8cae-a249a55bf201/20260703022858/az_nova_backup_1e68222b-ac10-4ee4-a8d7-2389b6c7872e_sha256file in container: tempest-volumesbackupstest-backup-container-507637182. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:29:29.613898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] delete 1e68222b-ac10-4ee4-a8d7-2389b6c7872e finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:29:29.650452 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:29:29.662228 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] Created reservations ['06a6def7-6209-41cd-99a1-2b4a6f2ead2e', '66b3cc57-25bf-4b52-9dac-5c5341b0c358'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:29:29.677177 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-90ad5130-b428-4071-914c-4c898512925a tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup 1e68222b-ac10-4ee4-a8d7-2389b6c7872e deleted. Jul 03 02:29:39.673521 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=44,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:30:03.059814 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:30:03.060383 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:30:40.501537 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: 6fd1187f-6ec2-4e37-975e-053c922b5dfa volume: da37a823-a7f2-44a8-82fc-6a71e09d8235. Jul 03 02:30:40.508987 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1912445707',created_at=2026-07-03T02:30:40Z,data_timestamp=2026-07-03T02:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-25504401',encryption_key_id=None,fail_reason=None,host='np0000004352',id=6fd1187f-6ec2-4e37-975e-053c922b5dfa,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=da37a823-a7f2-44a8-82fc-6a71e09d8235) Jul 03 02:30:40.606900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:30:40.607236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:30:40.607724 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:30:40.621298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:30:40.642946 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:30:40.652841 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:30:40.653088 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:30:40.662224 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:30:40.663714 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e', 'fe80::fc16:3eff:feb7:c9c9', 'fe80::fc16:3eff:fe70:2f34', 'fe80::3c0f:e6ff:fe8a:3301', 'fe80::fc16:3eff:fecd:237c', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe62:f44c', 'fe80::a467:15ff:fe3f:44f0', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe24:35b0', 'fe80::e46b:14ff:fedd:6ff5', 'fe80::fc16:3eff:fe23:c33d', 'fe80::548e:f1ff:fe6e:f611', 'fe80::fc16:3eff:fe07:fe7a', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:30:40.664101 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:30:40.664101 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:30:40.664617 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:30:41.168679 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:30:41.169134 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:30:41.169286 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:30:41.382132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.213s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:30:41.382454 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:30:41.396834 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:30:41.397360 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:30:41.397907 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:30:41.409180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:30:41.409180 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac] added Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:30:41.420688 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:41.421038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:30:41.421437 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:30:41.421694 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:30:42.423376 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:30:42.435448 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:42.448552 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.467458 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.467916 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:30:42.517210 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac, portal: 192.168.40.100,3260] Jul 03 02:30:42.517210 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac, portal: 192.168.40.100,3260] successful. Jul 03 02:30:42.517210 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:42.533484 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac (non-flash) Jul 03 02:30:42.552115 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-020fc92e-67f0-4b15-a74c-6b133787cc27 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fa30d4e-29b6-4120-b72f-60a6ec8f5b5e (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac (non-flash) Jul 03 02:30:42.552439 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:30:42.552766 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:30:42.552876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:30:42.554704 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] HCTL ('21', '-', '-', 0) found on session 95 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:30:42.554898 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Scanning host 21 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:30:42.572922 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 95 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:30:42.572922 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:30:43.577731 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.193s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:30:43.577731 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2405ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799036', 'path': '/dev/sdp'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:30:43.577731 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdp {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:30:43.595969 np0000004352 sudo[133653]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdp Jul 03 02:30:43.596842 np0000004352 sudo[133653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:30:43.936167 np0000004352 sudo[133653]: pam_unix(sudo:session): session closed for user root Jul 03 02:30:43.940513 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdp" returned: 0 in 0.362s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:30:43.979451 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:30:43.988268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1912445707,backup: 6fd1187f-6ec2-4e37-975e-053c922b5dfa. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:30:44.058769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:30:44.068587 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] starting backup of volume: da37a823-a7f2-44a8-82fc-6a71e09d8235, volume size: 1073741824, object names prefix volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:30:44.252022 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:44.502650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:44.502795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:44.614282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:44.614899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:44.812478 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:45.069814 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:45.069967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:45.203315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:45.203575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:45.424488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:45.687029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:45.687451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:45.790697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:45.790875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:45.981367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:46.262068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:46.262399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:46.368255 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:46.368476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:46.607294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:46.889123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:46.889554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:46.994593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:46.994766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:47.188665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:47.448324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:47.448566 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:47.567184 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:47.567353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:47.791594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:48.061212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:48.061585 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:48.180387 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:48.180649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:48.395762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:48.660849 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:48.660960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:48.765399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:48.766905 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:48.970270 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:49.235155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:49.235606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:49.353892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:49.354032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:49.555643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:49.819436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:49.819629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:49.922545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:49.922837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:50.119092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:50.372564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:50.373088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:50.487105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:50.487347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:50.691794 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:50.943377 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:50.943553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:51.047058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:51.047411 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:51.224437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:51.469766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:51.469766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:51.577939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:51.577939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:51.768933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:52.043555 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:52.043732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:52.163486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:52.163676 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:52.334473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:52.594034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:52.594460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:52.706184 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:52.706358 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:52.913325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:53.169966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:53.170086 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:53.276061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:53.276269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:53.471360 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:53.729181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:53.729181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:53.843693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:53.843693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:54.059972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:54.332179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:54.332179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:54.456625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:54.456746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:54.679344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:54.943100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:54.943515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:55.053822 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:55.053963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:55.250324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:55.547210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:55.547472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:55.662543 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:55.662744 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:55.771431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:30:55.893980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:30:55.894082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:30:55.960257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup MD5 for volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:30:55.960649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:30:55.966441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:30:55.970950 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:30:55.971087 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:30:55.974281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:30:55.974400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:30:55.976764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:30:55.976964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1912445707, sha256file filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:30:56.034834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:30:56.035677 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1912445707, metadata filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:30:56.067202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6fd1187f-6ec2-4e37-975e-053c922b5dfa",\n "backup_name": "tempest-VolumesBackupsTest-Backup-25504401",\n "created_at": "2026-07-03 02:30:40+00:00",\n "objects": [\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "da37a823-a7f2-44a8-82fc-6a71e09d8235",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"da37a823-a7f2-44a8-82fc-6a71e09d8235\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:29:32.000000\\", \\"launched_at\\": \\"2026-07-03T02:29:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-416175437\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:29:31.000000\\", \\"updated_at\\": \\"2026-07-03T02:30:40.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:30:56.071919 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] backup 6fd1187f-6ec2-4e37-975e-053c922b5dfa finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:30:56.212587 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdp {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:30:56.233976 np0000004352 sudo[134103]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdp Jul 03 02:30:56.235077 np0000004352 sudo[134103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:30:56.561273 np0000004352 sudo[134103]: pam_unix(sudo:session): session closed for user root Jul 03 02:30:56.563404 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdp" returned: 0 in 0.351s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:30:56.563974 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799036', 'path': '/dev/sdp'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:30:56.564158 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:30:56.564595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:30:56.564947 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:30:56.576877 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:56.577495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:30:56.577495 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:30:56.577495 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:30:56.577495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac (non-flash) Jul 03 02:30:56.602443 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac (non-flash) Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:30:56.602934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', '95')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:30:56.603349 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac', '95')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:30:56.604293 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x783584d289a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac'): ({'sdp'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:30:56.604548 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdp {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:30:56.615034 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdp {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:30:56.621795 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:30:56.663684 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdp have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:30:56.663863 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdp have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:30:56.665240 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdp'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:30:56.674746 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Device paths {'sdp'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:30:56.675061 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:30:56.684900 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:56.716344 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac, portal: 192.168.40.100,3260] Jul 03 02:30:56.716344 np0000004352 cinder-backup[101397]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-8b852299-fe8e-4c9e-bdaa-f1fcf8124aac, portal: 192.168.40.100,3260] successful. Jul 03 02:30:56.716344 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:56.735522 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:56.735804 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.171s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:30:56.735988 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (172ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:30:57.775618 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8dbb3301-0f70-4815-b5ef-732663c060df tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: 6fd1187f-6ec2-4e37-975e-053c922b5dfa. Jul 03 02:30:58.043693 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: 03c5365b-cbff-4b90-8fb2-a2945c77a696 volume: da37a823-a7f2-44a8-82fc-6a71e09d8235. Jul 03 02:30:58.053840 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:30:57Z,data_timestamp=2026-07-03T02:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004352',id=03c5365b-cbff-4b90-8fb2-a2945c77a696,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(6fd1187f-6ec2-4e37-975e-053c922b5dfa),parent_id='6fd1187f-6ec2-4e37-975e-053c922b5dfa',project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=da37a823-a7f2-44a8-82fc-6a71e09d8235) Jul 03 02:30:58.128488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:30:58.128731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:30:58.129381 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:30:58.139117 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:30:58.156578 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:30:58.167945 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:30:58.168199 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:30:58.175342 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:30:58.177313 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e', 'fe80::fc16:3eff:feb7:c9c9', 'fe80::fc16:3eff:fe70:2f34', 'fe80::3c0f:e6ff:fe8a:3301', 'fe80::fc16:3eff:fecd:237c', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe62:f44c', 'fe80::a467:15ff:fe3f:44f0', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe24:35b0', 'fe80::e46b:14ff:fedd:6ff5', 'fe80::fc16:3eff:fe07:fe7a', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:30:58.177512 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:30:58.177708 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:30:58.178063 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:30:58.682514 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:30:58.682987 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a8a0796-a054-43cf-b8f7-caa8406ab375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:30:58.683204 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:30:58.683809 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:30:58.684109 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a8a0796-a054-43cf-b8f7-caa8406ab375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:30:58.694058 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:30:58.694586 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:30:58.694872 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:30:58.708000 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:30:58.708000 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375] added Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:30:58.720025 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:58.720465 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:30:58.720770 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:30:58.721032 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:30:59.722895 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:30:59.735009 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:59.745779 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.761208 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.761711 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:30:59.801653 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375, portal: 192.168.40.100,3260] Jul 03 02:30:59.801653 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375, portal: 192.168.40.100,3260] successful. Jul 03 02:30:59.801653 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:59.811943 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 (non-flash) Jul 03 02:30:59.826743 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [94] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-76e7fcca-3391-48a2-8aee-85b41d0952d4 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 (non-flash) Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:30:59.827183 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:30:59.828049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:30:59.828253 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] HCTL ('11', '-', '-', 0) found on session 96 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:30:59.828368 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:30:59.839021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:30:59.839021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a8a0796-a054-43cf-b8f7-caa8406ab375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:31:00.841732 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.158s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:31:00.842126 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2159ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799040', 'path': '/dev/sdf'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:31:00.842205 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:00.858299 np0000004352 sudo[134212]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 02:31:00.858975 np0000004352 sudo[134212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:31:01.155015 np0000004352 sudo[134212]: pam_unix(sudo:session): session closed for user root Jul 03 02:31:01.157112 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.314s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:31:01.192730 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:31:01.202064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1912445707, sha256 filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:31:01.233031 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:31:01.239532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _create_container started, container: volumebackups,backup: 03c5365b-cbff-4b90-8fb2-a2945c77a696. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:31:01.299197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:31:01.305371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] starting backup of volume: da37a823-a7f2-44a8-82fc-6a71e09d8235, volume size: 1073741824, object names prefix volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:31:03.066575 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:31:03.066575 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:31:05.674637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:31:05.681562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:31:05.681788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:31:05.686523 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:31:05.686704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:31:05.690236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:31:05.690576 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:31:05.757595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:31:05.758283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: volumebackups, metadata filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:31:05.783336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "03c5365b-cbff-4b90-8fb2-a2945c77a696",\n "backup_name": null,\n "created_at": "2026-07-03 02:30:58+00:00",\n "objects": [],\n "parent_id": "6fd1187f-6ec2-4e37-975e-053c922b5dfa",\n "version": "1.0.0",\n "volume_id": "da37a823-a7f2-44a8-82fc-6a71e09d8235",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"da37a823-a7f2-44a8-82fc-6a71e09d8235\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:29:32.000000\\", \\"launched_at\\": \\"2026-07-03T02:29:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-416175437\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:29:31.000000\\", \\"updated_at\\": \\"2026-07-03T02:30:58.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:31:05.789386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] backup 03c5365b-cbff-4b90-8fb2-a2945c77a696 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:31:05.922167 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:05.940700 np0000004352 sudo[134328]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 02:31:05.941405 np0000004352 sudo[134328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:31:06.256681 np0000004352 sudo[134328]: pam_unix(sudo:session): session closed for user root Jul 03 02:31:06.259279 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.337s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:31:06.264746 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a8a0796-a054-43cf-b8f7-caa8406ab375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799040', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:31:06.264746 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:31:08.225431 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.966s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:31:08.225806 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a8a0796-a054-43cf-b8f7-caa8406ab375', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:31:08.240052 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:08.269600 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375 (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:31:08.269961 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49195636-c63b-493e-8875-cb2aba2f39de', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', '96'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd', '98')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:31:08.270247 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375', '96')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:31:08.271208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x783584cf62a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375'): ({'sdf'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:31:08.271467 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdf {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:31:08.281108 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdf {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:31:08.290155 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:31:08.341573 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:31:08.341810 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:31:08.344067 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:31:08.356736 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:31:08.357011 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:31:08.366739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:08.406818 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375, portal: 192.168.40.100,3260] Jul 03 02:31:08.406818 np0000004352 cinder-backup[101397]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-7a8a0796-a054-43cf-b8f7-caa8406ab375, portal: 192.168.40.100,3260] successful. Jul 03 02:31:08.406818 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:08.425766 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:08.426161 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.201s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:31:08.426317 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (2166ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:31:09.469175 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8ceb0c95-93e6-4110-8610-e530d92b1709 tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: 03c5365b-cbff-4b90-8fb2-a2945c77a696. Jul 03 02:31:10.359624 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: 03c5365b-cbff-4b90-8fb2-a2945c77a696. Jul 03 02:31:10.364901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:31:10.365216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:31:10.365461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] delete started, backup: 03c5365b-cbff-4b90-8fb2-a2945c77a696, container: volumebackups, prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:31:10.412915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_metadata', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:31:10.433143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:10.451771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023101/az_nova_backup_03c5365b-cbff-4b90-8fb2-a2945c77a696_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:10.451964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] delete 03c5365b-cbff-4b90-8fb2-a2945c77a696 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:31:10.485470 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:31:10.499603 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] Created reservations ['0ff2a2a3-fc7c-4de7-b1ea-3c680b64420e', 'f7a066e5-80a7-4e39-be12-479cb03ff5e5'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:31:10.520015 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5ac16f13-4591-4f00-b1c6-9511b943b67e tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup 03c5365b-cbff-4b90-8fb2-a2945c77a696 deleted. Jul 03 02:31:11.521219 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Create backup started, backup: 5c49a49e-b076-43e4-ab61-91e5a906c37c volume: da37a823-a7f2-44a8-82fc-6a71e09d8235. Jul 03 02:31:11.527039 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupstest-backup-container-1074712338',created_at=2026-07-03T02:31:11Z,data_timestamp=2026-07-03T02:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1822118574',encryption_key_id=None,fail_reason=None,host='np0000004352',id=5c49a49e-b076-43e4-ab61-91e5a906c37c,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(6fd1187f-6ec2-4e37-975e-053c922b5dfa),parent_id='6fd1187f-6ec2-4e37-975e-053c922b5dfa',project_id='7de1b81420d7488f991695d2bc1f15a7',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='7fb70befd1dd4bae81103733bda1dd6c',volume_id=da37a823-a7f2-44a8-82fc-6a71e09d8235) Jul 03 02:31:11.601376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:31:11.601665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:31:11.602084 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:31:11.611544 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:31:11.629099 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:11.639719 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:31:11.640194 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:31:11.648523 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:31:11.650833 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed2:2b48', 'fe80::e84a:9fff:fecb:291e', 'fe80::fc16:3eff:fe70:2f34', 'fe80::3c0f:e6ff:fe8a:3301', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe62:f44c', 'fe80::a467:15ff:fe3f:44f0', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe24:35b0', 'fe80::e46b:14ff:fedd:6ff5', 'fe80::fc16:3eff:fe07:fe7a', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:31:11.653002 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:31:11.653002 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:31:11.653002 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:31:12.158026 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:31:12.158393 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:31:12.158612 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:31:12.159183 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:31:12.159428 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:31:12.169593 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:31:12.169967 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:31:12.170170 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:31:12.179533 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:31:12.179533 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2] added Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:31:12.190302 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:12.190660 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:31:12.190895 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0206(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:31:12.191069 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:31:13.192299 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:31:13.203474 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:13.214583 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.228489 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.228889 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:31:13.271246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2, portal: 192.168.40.100,3260] Jul 03 02:31:13.271246 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2, portal: 192.168.40.100,3260] successful. Jul 03 02:31:13.271246 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:13.281957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 (non-flash) Jul 03 02:31:13.299297 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 (non-flash) Jul 03 02:31:13.299569 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:31:13.300034 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:31:13.300228 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:31:13.301521 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] HCTL ('8', '-', '-', 0) found on session 99 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:31:13.301715 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:31:13.317299 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Searching for a device in session 99 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:31:13.317488 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:31:14.321070 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.162s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:31:14.321486 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] <== connect_volume: return (2162ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdc'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:31:14.321554 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:14.337520 np0000004352 sudo[134712]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 02:31:14.338214 np0000004352 sudo[134712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:31:14.641822 np0000004352 sudo[134712]: pam_unix(sudo:session): session closed for user root Jul 03 02:31:14.643738 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.322s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:31:14.679898 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:31:14.684118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _read_sha256file started, container name: tempest-volumesbackupstest-backup-container-1912445707, sha256 filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:31:14.711140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:31:14.717632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _create_container started, container: tempest-volumesbackupstest-backup-container-1074712338,backup: 5c49a49e-b076-43e4-ab61-91e5a906c37c. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:31:14.757635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] generate_object_name_prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:31:14.764148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] starting backup of volume: da37a823-a7f2-44a8-82fc-6a71e09d8235, volume size: 1073741824, object names prefix volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:31:18.692611 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:31:18.697790 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:31:18.698009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:31:18.701928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:31:18.702090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:31:18.704905 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:31:18.705133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _write_sha256file started, container name: tempest-volumesbackupstest-backup-container-1074712338, sha256file filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:31:18.763851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:31:18.764562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _write_metadata started, container name: tempest-volumesbackupstest-backup-container-1074712338, metadata filename: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:31:18.790070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "5c49a49e-b076-43e4-ab61-91e5a906c37c",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1822118574",\n "created_at": "2026-07-03 02:31:11+00:00",\n "objects": [],\n "parent_id": "6fd1187f-6ec2-4e37-975e-053c922b5dfa",\n "version": "1.0.0",\n "volume_id": "da37a823-a7f2-44a8-82fc-6a71e09d8235",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"da37a823-a7f2-44a8-82fc-6a71e09d8235\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"7fb70befd1dd4bae81103733bda1dd6c\\", \\"project_id\\": \\"7de1b81420d7488f991695d2bc1f15a7\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"attached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:29:32.000000\\", \\"launched_at\\": \\"2026-07-03T02:29:32.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-416175437\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"in-use\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:29:31.000000\\", \\"updated_at\\": \\"2026-07-03T02:31:11.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:31:18.795896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] backup 5c49a49e-b076-43e4-ab61-91e5a906c37c finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:31:18.925386 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:18.942800 np0000004352 sudo[134972]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 02:31:18.943605 np0000004352 sudo[134972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:31:19.256536 np0000004352 sudo[134972]: pam_unix(sudo:session): session closed for user root Jul 03 02:31:19.259146 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.333s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:31:19.259857 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799048', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:31:19.260049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:31:19.260553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:31:19.260989 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:31:19.276780 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 (non-flash) Jul 03 02:31:19.303179 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [97] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2 (non-flash) Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:31:19.303512 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44b41c32-c087-425d-bdfc-d1de08d77cd6', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c7740bb-ecf2-4f51-aaf9-e8248c4c1c68', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-da37a823-a7f2-44a8-82fc-6a71e09d8235', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d8c33bdf-6c56-4080-81d6-bde4e4cbabcd', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', '99')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:31:19.303946 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2', '99')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:31:19.304738 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Resulting device map defaultdict(. at 0x78357a805300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2'): ({'sdc'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:31:19.304919 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Removing single pathed devices sdc {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:31:19.315202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Flushing IO for device /dev/sdc {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:31:19.323092 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:31:19.359406 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:31:19.359594 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:31:19.360953 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:31:19.370546 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:31:19.370784 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:31:19.382342 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:19.420768 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2, portal: 192.168.40.100,3260] Jul 03 02:31:19.420768 np0000004352 cinder-backup[101397]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-c32dd2ad-ea4c-4752-88b5-1606add9f5b2, portal: 192.168.40.100,3260] successful. Jul 03 02:31:19.420768 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:19.437784 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:31:19.438040 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.178s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:31:19.438205 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] <== disconnect_volume: return (178ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:31:20.492312 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-42eec50e-7f25-4ec4-badb-66821544525e tempest-VolumesBackupsTest-91322192 None] Create backup finished. backup: 5c49a49e-b076-43e4-ab61-91e5a906c37c. Jul 03 02:31:20.745216 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: 5c49a49e-b076-43e4-ab61-91e5a906c37c. Jul 03 02:31:20.750183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:31:20.750183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:31:20.750183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] delete started, backup: 5c49a49e-b076-43e4-ab61-91e5a906c37c, container: tempest-volumesbackupstest-backup-container-1074712338, prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:31:20.798153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_metadata', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:31:20.821891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_metadata in container: tempest-volumesbackupstest-backup-container-1074712338. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:20.842803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023114/az_nova_backup_5c49a49e-b076-43e4-ab61-91e5a906c37c_sha256file in container: tempest-volumesbackupstest-backup-container-1074712338. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:20.843177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] delete 5c49a49e-b076-43e4-ab61-91e5a906c37c finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:31:20.877293 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:31:20.892772 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] Created reservations ['7e9422f2-00f6-49e5-8ad4-f9729f550fe0', '6efe2a67-4994-48d4-9830-ec2c03bcf4fc'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:31:20.922820 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dab0e73d-a2a3-49a4-a365-e096f59861a9 tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup 5c49a49e-b076-43e4-ab61-91e5a906c37c deleted. Jul 03 02:31:21.883958 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] Delete backup started, backup: 6fd1187f-6ec2-4e37-975e-053c922b5dfa. Jul 03 02:31:21.885953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7de1b81420d7488f991695d2bc1f15a7 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:31:21.886109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:31:21.886250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] delete started, backup: 6fd1187f-6ec2-4e37-975e-053c922b5dfa, container: tempest-volumesbackupstest-backup-container-1912445707, prefix: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:31:21.928924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] generated object list: ['volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00001', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00002', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00003', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00004', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00005', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00006', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00007', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00008', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00009', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00010', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00011', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00012', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00013', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00014', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00015', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00016', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00017', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00018', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00019', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00020', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00021', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_metadata', 'volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:31:21.949120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00001 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:21.971539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00002 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:21.994276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00003 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.028361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00004 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.055541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00005 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.078159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00006 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.098226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00007 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.120650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00008 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.140367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00009 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.159076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00010 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.180006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00011 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.198528 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00012 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.218111 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00013 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.237135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00014 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.257207 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00015 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.278215 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00016 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.300935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00017 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.330339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00018 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.355069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00019 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.387011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00020 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.408810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa-00021 in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.430559 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_metadata in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.464712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] deleted object: volume_da37a823-a7f2-44a8-82fc-6a71e09d8235/20260703023044/az_nova_backup_6fd1187f-6ec2-4e37-975e-053c922b5dfa_sha256file in container: tempest-volumesbackupstest-backup-container-1912445707. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:31:22.464923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] delete 6fd1187f-6ec2-4e37-975e-053c922b5dfa finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:31:22.495795 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:31:22.507390 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] Created reservations ['c9a044ab-d21f-4c12-9814-804094e565a7', '3d9e2b99-943b-4316-97bb-af62d2f438fc'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:31:22.521625 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a6a905cf-9436-43f7-ac4c-0a9a2d6184c8 tempest-VolumesBackupsTest-91322192 None] Delete backup finished, backup 6fd1187f-6ec2-4e37-975e-053c922b5dfa deleted. Jul 03 02:31:32.519063 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=130,cinder:UPDATE=42,cinder:INSERT=6 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:31:59.802264 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Create backup started, backup: f8b568e5-6aaa-4388-be79-a0e60a6da623 volume: 06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 snapshot: 13e120f2-4283-46c8-be74-15b260bd2807. Jul 03 02:31:59.811520 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumessnapshottestjson-backup-container-197549434',created_at=2026-07-03T02:31:59Z,data_timestamp=2026-07-03T02:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1312032834',encryption_key_id=None,fail_reason=None,host='np0000004352',id=f8b568e5-6aaa-4388-be79-a0e60a6da623,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='99fe8d5d98ba4218a03a5e6b311b3faf',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='13e120f2-4283-46c8-be74-15b260bd2807',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f42fbccd23374558a99e8e6daa0148b4',volume_id=06362ad6-6e11-4297-9cd8-e5aa60ad7cc6) Jul 03 02:31:59.901976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_99fe8d5d98ba4218a03a5e6b311b3faf {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:31:59.902131 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:31:59.902546 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:31:59.914750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:31:59.936288 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:31:59.949177 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:31:59.949522 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:31:59.959456 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:31:59.960628 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe1c:a03f', 'fe80::fc16:3eff:fe6b:a7c4', 'fe80::fc16:3eff:fe24:35b0', 'fe80::e46b:14ff:fedd:6ff5'] Jul 03 02:31:59.960747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:31:59.960865 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:31:59.961093 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:32:00.466057 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:32:00.466057 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f19fe31c-264d-4299-8296-113d33a585c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:32:00.466057 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:32:00.466528 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:32:00.466745 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f19fe31c-264d-4299-8296-113d33a585c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:32:00.479534 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:32:00.479930 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:32:00.480151 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:32:00.493181 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:32:00.493181 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5] added Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:32:00.511317 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:00.511596 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:32:00.512100 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:32:00.512402 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:32:01.513832 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:32:01.529268 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:01.541583 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:01.557166 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.557166 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.557166 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.557166 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.557166 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:32:01.557507 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.557507 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.557507 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.557507 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.557507 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:32:01.593711 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5, portal: 192.168.40.100,3260] Jul 03 02:32:01.593711 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5, portal: 192.168.40.100,3260] successful. Jul 03 02:32:01.593711 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:01.605677 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 (non-flash) Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.623084 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 (non-flash) Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:01.623395 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:32:01.623723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:32:01.623878 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:32:01.624744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] HCTL ('11', '-', '-', 0) found on session 106 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:32:01.624902 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:32:01.641022 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:32:02.642659 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:32:02.643008 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f19fe31c-264d-4299-8296-113d33a585c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:32:02.643460 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.177s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:32:02.643637 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] <== connect_volume: return (2177ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799069', 'path': '/dev/sdf'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:32:02.643941 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:32:02.660867 np0000004352 sudo[137034]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 02:32:02.661654 np0000004352 sudo[137034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:32:02.987815 np0000004352 sudo[137034]: pam_unix(sudo:session): session closed for user root Jul 03 02:32:02.991980 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.347s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:32:03.040535 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:32:03.048598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _create_container started, container: tempest-volumessnapshottestjson-backup-container-197549434,backup: f8b568e5-6aaa-4388-be79-a0e60a6da623. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:32:03.063746 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:32:03.063746 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:32:03.274439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] generate_object_name_prefix: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:32:03.282495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] starting backup of volume: 06362ad6-6e11-4297-9cd8-e5aa60ad7cc6, volume size: 1073741824, object names prefix volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:32:03.524986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:03.804587 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:03.804952 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:03.945370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:03.945545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:04.157188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:04.443439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:04.443628 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:04.563841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:04.564003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:04.771926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:05.039136 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:05.040147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:05.161321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:05.161573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:05.396945 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:05.687461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:05.687995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:05.807799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:05.808117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:06.037277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:06.305007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:06.305409 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:06.419154 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:06.419261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:06.653411 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:06.927753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:06.927753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:07.059375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:07.059375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:07.279820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:07.551995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:07.552517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:07.658109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:07.658349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:07.839448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:08.121647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:08.121647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:08.237697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:08.237697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:08.440836 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:08.712395 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:08.712893 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:08.848512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:08.848512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:09.109513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:09.389350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:09.389621 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:09.489592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:09.489592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:09.688433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:09.962332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:09.962636 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:10.084926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:10.086200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:10.313699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:10.589141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:10.589288 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:10.707878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:10.707878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:10.894609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:11.145932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:11.145932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:11.253751 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:11.253878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:11.440057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:11.955957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:11.956107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:12.067149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:12.067301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:12.257199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:12.523061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:12.523201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:12.628040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:12.628040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:12.814405 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:13.072872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:13.073029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:13.183591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:13.183753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:13.417274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:13.672178 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:13.672381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:13.794693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:13.794865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:14.005177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:14.269779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:14.269999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:14.384686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:14.384838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:14.578121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:14.831904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:14.832090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:14.936810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:14.936974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:15.163256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:15.420085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:15.420209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:15.533957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:15.534116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:15.647942 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:32:15.774475 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:32:15.774660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:32:15.844600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup MD5 for volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:32:15.844709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:32:15.851216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:32:15.859984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:32:15.859984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:32:15.864261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:32:15.864543 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:32:15.868095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:32:15.868317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _write_sha256file started, container name: tempest-volumessnapshottestjson-backup-container-197549434, sha256file filename: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:32:15.940205 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:32:15.940923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _write_metadata started, container name: tempest-volumessnapshottestjson-backup-container-197549434, metadata filename: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:32:15.968414 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "f8b568e5-6aaa-4388-be79-a0e60a6da623",\n "backup_name": "tempest-VolumesSnapshotTestJSON-Backup-1312032834",\n "created_at": "2026-07-03 02:32:00+00:00",\n "objects": [\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "06362ad6-6e11-4297-9cd8-e5aa60ad7cc6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"06362ad6-6e11-4297-9cd8-e5aa60ad7cc6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f42fbccd23374558a99e8e6daa0148b4\\", \\"project_id\\": \\"99fe8d5d98ba4218a03a5e6b311b3faf\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:31:57.000000\\", \\"launched_at\\": \\"2026-07-03T02:31:58.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesSnapshotTestJSON-Volume-593930504\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:31:57.000000\\", \\"updated_at\\": \\"2026-07-03T02:31:58.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:32:15.974018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] backup f8b568e5-6aaa-4388-be79-a0e60a6da623 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:32:16.101007 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:32:16.118635 np0000004352 sudo[137412]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 02:32:16.119505 np0000004352 sudo[137412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:32:16.417384 np0000004352 sudo[137412]: pam_unix(sudo:session): session closed for user root Jul 03 02:32:16.421466 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.318s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:32:16.424449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f19fe31c-264d-4299-8296-113d33a585c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799069', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:32:16.424449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:32:16.424449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:32:16.425576 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f19fe31c-264d-4299-8296-113d33a585c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:32:16.439670 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:32:16.442141 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:32:16.442141 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:32:16.442141 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:32:16.442141 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:32:16.467934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:32:16.468248 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5', '106')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:32:16.469434 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Resulting device map defaultdict(. at 0x78357a4ecae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5'): ({'sdf'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:32:16.469740 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Removing single pathed devices sdf {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:32:16.483504 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Flushing IO for device /dev/sdf {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:32:16.491621 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:32:16.541601 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:32:16.541740 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:32:16.542680 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:32:16.552229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:32:16.552495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:32:16.562715 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:16.597208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5, portal: 192.168.40.100,3260] Jul 03 02:32:16.597208 np0000004352 cinder-backup[101397]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-f19fe31c-264d-4299-8296-113d33a585c5, portal: 192.168.40.100,3260] successful. Jul 03 02:32:16.597208 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:16.611505 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:32:16.611741 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.187s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:32:16.611887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] <== disconnect_volume: return (188ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:32:17.668242 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d4f6527f-ea0b-452a-9b0b-083c353894f0 tempest-VolumesSnapshotTestJSON-2100959499 None] Create backup finished. backup: f8b568e5-6aaa-4388-be79-a0e60a6da623. Jul 03 02:32:18.275365 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] Delete backup started, backup: f8b568e5-6aaa-4388-be79-a0e60a6da623. Jul 03 02:32:18.279119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_99fe8d5d98ba4218a03a5e6b311b3faf {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:32:18.279300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:32:18.279486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] delete started, backup: f8b568e5-6aaa-4388-be79-a0e60a6da623, container: tempest-volumessnapshottestjson-backup-container-197549434, prefix: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:32:18.321600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] generated object list: ['volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00001', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00002', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00003', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00004', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00005', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00006', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00007', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00008', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00009', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00010', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00011', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00012', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00013', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00014', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00015', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00016', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00017', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00018', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00019', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00020', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00021', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_metadata', 'volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:32:18.341237 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00001 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.360066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00002 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.377383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00003 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.397553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00004 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.420573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00005 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.445227 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00006 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.462397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00007 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.479325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00008 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.495282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00009 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.512107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00010 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.528277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00011 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.548253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00012 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.565967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00013 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.586357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00014 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.605317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00015 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.627004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00016 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.646620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00017 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.662843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00018 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.681632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00019 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.698091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00020 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.715494 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623-00021 in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.733067 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_metadata in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.749363 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] deleted object: volume_06362ad6-6e11-4297-9cd8-e5aa60ad7cc6/20260703023203/az_nova_backup_f8b568e5-6aaa-4388-be79-a0e60a6da623_sha256file in container: tempest-volumessnapshottestjson-backup-container-197549434. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:32:18.749530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] delete f8b568e5-6aaa-4388-be79-a0e60a6da623 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:32:18.782233 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:32:18.795864 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] Created reservations ['af31d014-360a-4f57-af49-bdee43d4dbcc', 'be0f3c40-c002-4707-9e91-b706ed443988'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:32:18.815638 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9d0c3412-d66c-417b-8240-39f5f2d6ec83 tempest-VolumesSnapshotTestJSON-2100959499 None] Delete backup finished, backup f8b568e5-6aaa-4388-be79-a0e60a6da623 deleted. Jul 03 02:32:28.813244 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=41,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:33:03.062358 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:33:03.062944 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:33:06.056862 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:33:30.654157 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Create backup started, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c volume: 8d97939d-3a40-4663-ac5a-481bf03a69fe. Jul 03 02:33:30.662830 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:33:30Z,data_timestamp=2026-07-03T02:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1311707960',encryption_key_id=None,fail_reason=None,host='np0000004352',id=980cbedd-d350-43d4-9dd1-0d392b4a142c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c90b1bb0321472f882a7536b522b9e0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7487651cef4420bbe5cfa1b79bb7397',volume_id=8d97939d-3a40-4663-ac5a-481bf03a69fe) Jul 03 02:33:30.694779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:33:30.694959 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:33:30.695219 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:33:30.708500 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:33:30.726550 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:33:30.737712 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:33:30.737839 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:33:30.749814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:33:30.749814 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe1c:a03f', 'fe80::fc16:3eff:fec1:859d', 'fe80::e892:ebff:fe32:961e', 'fe80::fc16:3eff:febc:5e34', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe6b:a7c4', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:33:30.749814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:33:30.749814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:33:30.749814 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:33:31.252192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:33:31.252664 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:33:31.252856 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:33:31.253438 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:33:31.253702 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:33:31.265956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:33:31.266504 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:33:31.266776 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:33:31.280749 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:33:31.280749 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe] added Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:33:31.292595 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:31.292935 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:33:31.293294 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:33:31.293523 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:33:32.294485 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:33:32.305574 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:32.316488 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.332859 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.333219 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:33:32.375083 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] Jul 03 02:33:32.375083 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] successful. Jul 03 02:33:32.375083 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:32.385979 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.401221 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16743a21-2f71-4699-9f33-a127fd910617 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:32.401591 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:33:32.401935 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:33:32.402041 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:33:32.402912 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] HCTL ('13', '-', '-', 0) found on session 121 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:33:32.403097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:33:32.416269 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 121 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:33:32.416269 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:33:33.419390 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.166s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:33:33.419942 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (2166ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799079', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:33:33.420064 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:33:33.437012 np0000004352 sudo[141652]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:33:33.437774 np0000004352 sudo[141652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:33:33.776834 np0000004352 sudo[141652]: pam_unix(sudo:session): session closed for user root Jul 03 02:33:33.779484 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.359s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:33:33.828709 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:33:33.838716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _create_container started, container: volumebackups,backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:33:34.047769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] generate_object_name_prefix: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:33:34.055924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] starting backup of volume: 8d97939d-3a40-4663-ac5a-481bf03a69fe, volume size: 1073741824, object names prefix volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:33:34.248492 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:34.494914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:34.495406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:34.611453 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:34.611636 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:34.810444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:35.059219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:35.059434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:35.177007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:35.177193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:35.389023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:35.664271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:35.664824 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:35.764324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:35.764535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:35.958058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:36.205028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:36.205193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:36.304124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:36.304280 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:36.499296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:36.751180 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:36.751720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:36.853321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:36.853321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:37.026603 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:37.275066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:37.275213 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:37.377777 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:37.377968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:37.559915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:37.802099 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:37.802099 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:37.905049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:37.905049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:38.098753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:38.351653 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:38.351787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:38.455288 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:38.455467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:38.649192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:38.898846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:38.899370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:39.000520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:39.000683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:39.183997 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:39.448883 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:39.449015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:39.549992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:39.549992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:39.744854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:39.989633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:39.989633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:40.088899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:40.089106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:40.267089 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:40.512285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:40.512489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:40.607314 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:40.607457 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:40.795226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:41.045589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:41.045589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:41.146032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:41.146158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:41.340548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:41.590340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:41.590340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:41.714236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:41.714397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:41.938910 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:42.200507 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:42.200953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:42.306854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:42.307093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:42.496041 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:42.761705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:42.761941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:42.871799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:42.871977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:43.093434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:43.353712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:43.354584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:43.466438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:43.466607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:43.676148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:43.920890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:43.921093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:44.023888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:44.024114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:44.201469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:44.463999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:44.464379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:44.574443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:44.574443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:44.762780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:45.019891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:45.020236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:45.120756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:45.120940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:45.217316 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:45.343055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:45.343216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:45.402088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:45.402247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:45.409717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:33:45.414483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:33:45.414641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:33:45.421768 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:33:45.421993 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:33:45.426059 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:33:45.426367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:33:45.487716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:33:45.488306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _write_metadata started, container name: volumebackups, metadata filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:33:45.509916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "980cbedd-d350-43d4-9dd1-0d392b4a142c",\n "backup_name": "tempest-type-Backup-1311707960",\n "created_at": "2026-07-03 02:33:31+00:00",\n "objects": [\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8d97939d-3a40-4663-ac5a-481bf03a69fe",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8d97939d-3a40-4663-ac5a-481bf03a69fe\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f7487651cef4420bbe5cfa1b79bb7397\\", \\"project_id\\": \\"6c90b1bb0321472f882a7536b522b9e0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:33:30.000000\\", \\"launched_at\\": \\"2026-07-03T02:33:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-848193716\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:33:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:33:31.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:33:45.514475 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] backup 980cbedd-d350-43d4-9dd1-0d392b4a142c finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:33:45.639003 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:33:45.655411 np0000004352 sudo[142171]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:33:45.656220 np0000004352 sudo[142171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:33:45.946833 np0000004352 sudo[142171]: pam_unix(sudo:session): session closed for user root Jul 03 02:33:45.949333 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.310s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:33:45.949937 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799079', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:33:45.950108 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:33:51.325192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.375s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:33:51.327032 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:33:51.341926 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:51.372046 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', '121')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x78357a956200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:33:51.374409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:33:51.384873 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:33:51.392657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:33:51.433573 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:33:51.433573 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:33:51.433573 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:33:51.444871 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:33:51.444871 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:33:51.456143 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:51.495458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] Jul 03 02:33:51.495458 np0000004352 cinder-backup[101397]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] successful. Jul 03 02:33:51.495458 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:51.515810 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:51.515810 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.190s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:33:51.515810 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (5565ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:33:52.535736 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f11be659-388a-47f1-bc5d-9346e7e91f48 tempest-ProjectAdminTests33-230920511 None] Create backup finished. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c. Jul 03 02:33:53.157886 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Create backup started, backup: 41044c64-1b35-4754-bee7-4e61249f0cfc volume: 8d97939d-3a40-4663-ac5a-481bf03a69fe. Jul 03 02:33:53.163315 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:33:53Z,data_timestamp=2026-07-03T02:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004352',id=41044c64-1b35-4754-bee7-4e61249f0cfc,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c90b1bb0321472f882a7536b522b9e0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7487651cef4420bbe5cfa1b79bb7397',volume_id=8d97939d-3a40-4663-ac5a-481bf03a69fe) Jul 03 02:33:53.188520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:33:53.188712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:33:53.189170 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:33:53.198917 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:33:53.216676 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:33:53.225903 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:33:53.226143 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:33:53.233054 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:33:53.234260 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe1c:a03f', 'fe80::fc16:3eff:febc:5e34', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe6b:a7c4', 'fe80::fc16:3eff:fe2e:258f', 'fe80::84d4:c6ff:fe20:e2fb', 'fe80::fc16:3eff:fe4f:2140', 'fe80::70d5:31ff:fe6c:72e1'] Jul 03 02:33:53.234408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:33:53.234547 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:33:53.234784 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (45ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:33:53.741701 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:33:53.742237 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:33:53.742446 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:33:53.743028 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:33:53.743302 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:33:53.754644 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:33:53.755036 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:33:53.755287 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:33:53.768223 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:33:53.768223 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe] added Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:33:53.781784 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:53.781996 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:33:53.782713 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:33:53.782713 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:33:54.784210 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:33:54.795041 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:54.805815 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.822854 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.823395 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:33:54.882088 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] Jul 03 02:33:54.882088 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] successful. Jul 03 02:33:54.882088 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:54.894675 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.914986 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [104] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [105] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdbdfa9e-991e-42ae-a956-dfcbbb2ce3b8 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:33:54.915273 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:33:54.915668 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:33:54.915864 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:33:54.918934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] HCTL ('13', '-', '-', 0) found on session 130 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:33:54.919261 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:33:54.933689 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 130 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:33:54.934178 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:33:55.940228 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.197s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:33:55.941041 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (2197ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799079', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:33:55.941843 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:33:55.961960 np0000004352 sudo[142893]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:33:55.962731 np0000004352 sudo[142893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:33:56.367157 np0000004352 sudo[142893]: pam_unix(sudo:session): session closed for user root Jul 03 02:33:56.369278 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.428s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:33:56.420855 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:33:56.431306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _create_container started, container: volumebackups,backup: 41044c64-1b35-4754-bee7-4e61249f0cfc. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:33:56.471254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] generate_object_name_prefix: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:33:56.478834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] starting backup of volume: 8d97939d-3a40-4663-ac5a-481bf03a69fe, volume size: 1073741824, object names prefix volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:33:56.690000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:56.963444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:56.963444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:57.070483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:57.070664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:57.334663 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:57.581161 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:57.581302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:57.692107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:57.692275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:57.925141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:58.173823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:58.174308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:58.282159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:58.282391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:58.508194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:58.755218 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:58.755354 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:58.872620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:58.872846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:59.072072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:59.317158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:59.317527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:33:59.443488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:33:59.443922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:33:59.707499 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:33:59.975130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:33:59.975308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:00.098240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:00.098519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:00.297791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:00.546396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:00.546816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:00.658436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:00.658687 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:00.846453 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:01.105305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:01.106045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:01.229109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:01.229256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:01.434605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:01.687752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:01.688085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:01.788933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:01.789058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:01.996935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:02.277832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:02.278049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:02.389321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:02.389506 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:02.588489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:02.845446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:02.845994 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:02.958600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:02.958757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:03.060196 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:34:03.060393 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:34:03.183565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:03.456341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:03.456646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:03.562588 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:03.562754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:03.770047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:04.025304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:04.025810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:04.132848 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:04.133015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:04.335179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:04.585769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:04.585901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:04.686470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:04.686629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:04.860777 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:05.119721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:05.120215 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:05.238588 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:05.238833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:05.465529 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:05.721122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:05.721258 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:05.839091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:05.839279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:06.031292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:06.280793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:06.280793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:06.408949 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:06.409187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:06.618350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:06.866122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:06.866292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:06.992689 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:06.992891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:07.204916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:07.459269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:07.459711 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:07.570502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:07.570651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:07.816319 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:08.106066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:08.106240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:08.229393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:08.229575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:08.329898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:08.445716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:08.445932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:08.517401 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:08.517678 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:08.529185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:34:08.536752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:34:08.537009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:34:08.541577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:34:08.541804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:34:08.545095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:34:08.545460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:34:08.622344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:34:08.622928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _write_metadata started, container name: volumebackups, metadata filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:34:08.657318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "41044c64-1b35-4754-bee7-4e61249f0cfc",\n "backup_name": null,\n "created_at": "2026-07-03 02:33:53+00:00",\n "objects": [\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "8d97939d-3a40-4663-ac5a-481bf03a69fe",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"8d97939d-3a40-4663-ac5a-481bf03a69fe\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f7487651cef4420bbe5cfa1b79bb7397\\", \\"project_id\\": \\"6c90b1bb0321472f882a7536b522b9e0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:33:30.000000\\", \\"launched_at\\": \\"2026-07-03T02:33:30.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-848193716\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:33:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:33:53.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:34:08.662995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] backup 41044c64-1b35-4754-bee7-4e61249f0cfc finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:34:08.788184 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:08.803769 np0000004352 sudo[143197]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:34:08.804390 np0000004352 sudo[143197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:09.096191 np0000004352 sudo[143197]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:09.098334 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.310s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:09.098957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799079', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:09.099130 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:09.099616 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:09.099960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d97939d-3a40-4663-ac5a-481bf03a69fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:09.115142 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:09.116285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:34:09.116285 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:34:09.116285 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:34:09.116285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:09.145568 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:09.146100 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3', '122'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:34:09.146100 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe', '130')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:34:09.146827 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x78357a907b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:34:09.147018 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:34:09.159741 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:34:09.166122 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:34:09.224967 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:34:09.225180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:34:09.227340 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:34:09.239180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:34:09.239543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:34:09.252323 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:09.285634 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] Jul 03 02:34:09.285634 np0000004352 cinder-backup[101397]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-8d97939d-3a40-4663-ac5a-481bf03a69fe, portal: 192.168.40.100,3260] successful. Jul 03 02:34:09.285634 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:09.303442 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:09.303738 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.204s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:09.303906 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (205ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:10.329300 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-7ac79a94-47d1-4971-a959-c9958399563c tempest-ProjectAdminTests33-230920511 None] Create backup finished. backup: 41044c64-1b35-4754-bee7-4e61249f0cfc. Jul 03 02:34:10.585227 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: 41044c64-1b35-4754-bee7-4e61249f0cfc. Jul 03 02:34:10.594107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:10.594538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:10.594726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] delete started, backup: 41044c64-1b35-4754-bee7-4e61249f0cfc, container: volumebackups, prefix: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:34:10.636695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00001', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00002', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00003', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00004', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00005', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00006', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00007', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00008', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00009', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00010', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00011', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00012', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00013', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00014', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00015', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00016', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00017', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00018', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00019', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00020', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00021', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_metadata', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:34:10.658001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.681019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.704582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.724779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.749941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.772668 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.798664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.823995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.849034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.871003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.894749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.913268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.937099 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.964004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:10.988272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.009829 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.031612 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.056671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.077083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.100384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.126714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.148044 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.171046 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023356/az_nova_backup_41044c64-1b35-4754-bee7-4e61249f0cfc_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:11.171237 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] delete 41044c64-1b35-4754-bee7-4e61249f0cfc finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:34:11.211211 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:11.227220 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] Created reservations ['56489a22-1883-4809-9485-b94ad54485fb', '9782c1d9-75ed-4e2d-80a5-08bc6c157ec9'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:34:11.247069 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-07fcbca7-a33a-44bc-9ef1-c4f458658fe7 tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup 41044c64-1b35-4754-bee7-4e61249f0cfc deleted. Jul 03 02:34:11.973821 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Create backup started, backup: bf88251a-d4c7-470d-ad57-3ef33f8f422e volume: bb1c8532-d95f-4967-b6aa-81455e83dd39. Jul 03 02:34:11.984967 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:34:11Z,data_timestamp=2026-07-03T02:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-890955998',encryption_key_id=None,fail_reason=None,host='np0000004352',id=bf88251a-d4c7-470d-ad57-3ef33f8f422e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c90b1bb0321472f882a7536b522b9e0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7487651cef4420bbe5cfa1b79bb7397',volume_id=bb1c8532-d95f-4967-b6aa-81455e83dd39) Jul 03 02:34:12.010926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:12.011198 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:12.011432 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:12.021406 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:34:12.041171 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:12.051748 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:34:12.052153 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:34:12.061287 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:34:12.062938 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe1c:a03f', 'fe80::fc16:3eff:febc:5e34', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe6b:a7c4', 'fe80::fc16:3eff:fe2e:258f', 'fe80::84d4:c6ff:fe20:e2fb', 'fe80::fc16:3eff:fe4f:2140', 'fe80::70d5:31ff:fe6c:72e1', 'fe80::fc16:3eff:fe89:4371', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe82:f1ab', 'fe80::fc16:3eff:feb7:5810', 'fe80::e892:ebff:fe32:961e'] Jul 03 02:34:12.063167 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:34:12.063368 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:34:12.063673 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (51ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:12.568479 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:34:12.568581 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb1c8532-d95f-4967-b6aa-81455e83dd39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:12.569220 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:14.430595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.861s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:14.430595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb1c8532-d95f-4967-b6aa-81455e83dd39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:34:14.444958 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:14.445363 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:14.445617 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:14.455840 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:34:14.455840 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39] added Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:14.465992 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:14.466251 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:34:14.466523 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:34:14.466754 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:34:15.468176 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:34:15.480090 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:15.491745 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.506346 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.506884 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:15.557616 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39, portal: 192.168.40.100,3260] Jul 03 02:34:15.557616 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39, portal: 192.168.40.100,3260] successful. Jul 03 02:34:15.557616 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:15.568174 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.594980 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [123] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aec9a84d-a501-49df-a0e1-4145cb5c6af3 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a8d8ade-0626-44bb-987a-1b0f095adf4c (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-572fd4db-fdf5-4cf3-b601-ef0b945d6fe9 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:15.595594 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:34:15.596702 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] HCTL ('13', '-', '-', 0) found on session 133 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:34:15.596820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:34:15.609772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 133 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:34:15.609772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb1c8532-d95f-4967-b6aa-81455e83dd39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:34:16.613330 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:16.613786 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799088', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:16.613925 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:16.629912 np0000004352 sudo[143594]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:34:16.630653 np0000004352 sudo[143594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:16.936752 np0000004352 sudo[143594]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:16.938799 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.324s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:16.976492 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:16.982487 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _create_container started, container: volumebackups,backup: bf88251a-d4c7-470d-ad57-3ef33f8f422e. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:34:17.028614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] generate_object_name_prefix: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:34:17.041015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] starting backup of volume: bb1c8532-d95f-4967-b6aa-81455e83dd39, volume size: 1073741824, object names prefix volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:34:17.237523 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:17.477756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:17.477912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:17.581342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:17.581540 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:17.773926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:18.025050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:18.028966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:18.180490 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:18.180490 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:18.388754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:18.638277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:18.638404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:18.738286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:18.738469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:18.946585 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:19.224297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:19.224477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:19.348408 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:19.348627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:19.537760 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:19.800505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:19.800505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:19.904841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:19.905379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:20.085150 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:20.343732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:20.343869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:20.451366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:20.451584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:20.685715 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:20.939203 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:20.939343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:21.058508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:21.058655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:21.260994 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:21.556753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:21.556753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:21.673804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:21.673804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:21.878681 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:22.129785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:22.129785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:22.245123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:22.245258 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:22.443829 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:22.717833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:22.717971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:22.822128 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:22.822335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:23.037276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:23.300829 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:23.300975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:23.406015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:23.406202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:23.617225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:23.868569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:23.868720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:23.970807 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:23.970969 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:24.156097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:24.412949 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:24.413082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:24.543273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:24.543497 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:24.790632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:25.053082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:25.053232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:25.768334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:25.962315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:26.239254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:26.239451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:26.354010 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:26.354175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:26.358201 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=89,cinder:UPDATE=21,cinder:INSERT=2 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:34:26.620615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:26.890132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:26.890280 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:26.999030 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:26.999583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:27.180640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:27.441011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:27.441164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:27.545181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:27.545346 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:27.726760 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:27.979052 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:27.979188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:28.089707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:28.089707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:28.266550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:28.522922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:28.522922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:28.630404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:28.630605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:28.733999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:28.852252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:28.852361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:28.916827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:28.917070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:28.925313 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:34:28.932035 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:34:28.932213 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:34:28.935881 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:34:28.936017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:34:28.938710 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:34:28.938943 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:34:28.995055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:34:28.995810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _write_metadata started, container name: volumebackups, metadata filename: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:34:29.020017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "bf88251a-d4c7-470d-ad57-3ef33f8f422e",\n "backup_name": "tempest-type-Backup-890955998",\n "created_at": "2026-07-03 02:34:12+00:00",\n "objects": [\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "bb1c8532-d95f-4967-b6aa-81455e83dd39",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"bb1c8532-d95f-4967-b6aa-81455e83dd39\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f7487651cef4420bbe5cfa1b79bb7397\\", \\"project_id\\": \\"6c90b1bb0321472f882a7536b522b9e0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:34:11.000000\\", \\"launched_at\\": \\"2026-07-03T02:34:11.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2144558047\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:34:11.000000\\", \\"updated_at\\": \\"2026-07-03T02:34:12.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:34:29.025546 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] backup bf88251a-d4c7-470d-ad57-3ef33f8f422e finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:34:29.149263 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:29.164586 np0000004352 sudo[144027]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:34:29.165141 np0000004352 sudo[144027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:29.458749 np0000004352 sudo[144027]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:29.460911 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.311s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:29.461643 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb1c8532-d95f-4967-b6aa-81455e83dd39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799088', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:29.461862 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:29.462473 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:29.462917 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb1c8532-d95f-4967-b6aa-81455e83dd39', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:29.474319 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:29.474814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:34:29.474814 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:34:29.474814 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:34:29.474814 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:29.502967 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39 (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:29.503271 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:29.503547 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:34:29.503547 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39', '133')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:34:29.504727 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x783584b52ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:34:29.504960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:34:29.514777 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:34:29.523981 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:34:29.573395 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:34:29.573587 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:34:29.574949 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:34:29.586532 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:34:29.586787 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:34:29.597529 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:29.628263 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39, portal: 192.168.40.100,3260] Jul 03 02:34:29.628263 np0000004352 cinder-backup[101397]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-bb1c8532-d95f-4967-b6aa-81455e83dd39, portal: 192.168.40.100,3260] successful. Jul 03 02:34:29.628263 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:29.644151 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:29.644407 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.182s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:29.644634 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (182ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:30.667646 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aaa3009e-92a9-4a7a-b203-b124f881cdb9 tempest-ProjectAdminTests33-230920511 None] Create backup finished. backup: bf88251a-d4c7-470d-ad57-3ef33f8f422e. Jul 03 02:34:31.423305 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: bf88251a-d4c7-470d-ad57-3ef33f8f422e. Jul 03 02:34:31.428447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:31.428672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:31.428874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] delete started, backup: bf88251a-d4c7-470d-ad57-3ef33f8f422e, container: volumebackups, prefix: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:34:31.476690 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00001', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00002', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00003', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00004', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00005', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00006', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00007', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00008', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00009', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00010', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00011', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00012', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00013', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00014', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00015', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00016', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00017', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00018', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00019', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00020', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00021', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_metadata', 'volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:34:31.504478 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.527962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.551538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.573578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.592305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.612539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.632594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.652872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.673759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.696298 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.718370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.743868 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.772625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.801704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.829683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.854076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.879157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.901079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.922410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.945433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.969857 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:31.992915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:32.011874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_bb1c8532-d95f-4967-b6aa-81455e83dd39/20260703023417/az_nova_backup_bf88251a-d4c7-470d-ad57-3ef33f8f422e_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:32.012044 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] delete bf88251a-d4c7-470d-ad57-3ef33f8f422e finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:34:32.045508 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:32.060551 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] Created reservations ['7d4a4260-3804-4345-b6cb-ebc67008a590', '66e0e650-16d1-4967-b2a0-b529947ac6b9'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:34:32.079771 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f07c3cfd-720a-4299-bbb1-74d20b3c9ec3 tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup bf88251a-d4c7-470d-ad57-3ef33f8f422e deleted. Jul 03 02:34:32.550234 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dff7e175-e06b-49ec-952e-44211c82e1d4 tempest-ProjectAdminTests33-230920511 None] Export record started, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c. Jul 03 02:34:32.554914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dff7e175-e06b-49ec-952e-44211c82e1d4 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:32.554914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dff7e175-e06b-49ec-952e-44211c82e1d4 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:32.554914 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dff7e175-e06b-49ec-952e-44211c82e1d4 tempest-ProjectAdminTests33-230920511 None] Export record finished, backup 980cbedd-d350-43d4-9dd1-0d392b4a142c exported. Jul 03 02:34:34.505207 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:34.510372 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Create backup started, backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746 volume: ee68f692-7bcb-4246-978e-37cd7a9bad6e. Jul 03 02:34:34.518658 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:34:34Z,data_timestamp=2026-07-03T02:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-714058076',encryption_key_id=None,fail_reason=None,host='np0000004352',id=9a8bbc70-ad9a-4de5-8ddc-88a314021746,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c90b1bb0321472f882a7536b522b9e0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7487651cef4420bbe5cfa1b79bb7397',volume_id=ee68f692-7bcb-4246-978e-37cd7a9bad6e) Jul 03 02:34:34.545936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:34.546139 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:34.546413 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:34.559035 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:34:34.582786 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:34.594986 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:34:34.595492 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:34:34.603790 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:34:34.604983 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:fe1c:a03f', 'fe80::fc16:3eff:febc:5e34', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe6b:a7c4', 'fe80::fc16:3eff:fe89:4371', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe82:f1ab', 'fe80::fc16:3eff:feb7:5810', 'fe80::e892:ebff:fe32:961e'] Jul 03 02:34:34.605152 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:34:34.605219 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:34:34.605588 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:35.109431 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:34:35.109795 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:35.109945 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:35.110407 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:35.110610 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:34:35.132203 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:35.132618 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:35.132813 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:35.146368 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:34:35.146368 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e] added Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:34:35.158828 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:34:35.159267 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:34:36.160550 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:34:36.171605 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:36.181150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.194889 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.195121 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:36.242069 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e, portal: 192.168.40.100,3260] Jul 03 02:34:36.242069 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e, portal: 192.168.40.100,3260] successful. Jul 03 02:34:36.242069 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:36.256571 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.271838 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6998f8ad-0b4a-4179-acad-188e48b9ca46 (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:36.272030 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:36.272353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:36.272503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:34:36.273350 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] HCTL ('8', '-', '-', 0) found on session 134 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:34:36.273571 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:34:36.285620 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 134 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:34:36.285857 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:34:37.289495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:37.289899 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (2179ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799090', 'path': '/dev/sdc'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:37.290008 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:37.306302 np0000004352 sudo[144167]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 02:34:37.306947 np0000004352 sudo[144167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:37.667335 np0000004352 sudo[144167]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:37.669448 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.379s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:37.716694 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:37.725915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _create_container started, container: volumebackups,backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:34:37.777221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] generate_object_name_prefix: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:34:37.783767 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] starting backup of volume: ee68f692-7bcb-4246-978e-37cd7a9bad6e, volume size: 1073741824, object names prefix volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:34:37.985558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:38.245699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:38.245860 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:38.361976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:38.362316 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:38.600504 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:38.851164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:38.852725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:38.961181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:38.961326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:39.158538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:39.407269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:39.407701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:39.516033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:39.516444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:39.703667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:39.954090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:39.954090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:40.054971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:40.054971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:40.236362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:40.484509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:40.484971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:40.595005 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:40.595005 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:40.803960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:41.056817 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:41.057028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:41.157485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:41.157682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:41.345227 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:41.590438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:41.591119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:41.696185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:41.696285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:41.891640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:42.135349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:42.135500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:42.237090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:42.237222 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:42.426168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:42.697282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:42.697789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:42.809443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:42.809443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:43.017650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:43.270633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:43.270633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:43.375805 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:43.375914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:43.575055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:43.839951 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:43.840352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:43.939396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:43.939582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:44.132114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:44.380455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:44.380645 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:44.478738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:44.478922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:44.662787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:44.914939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:44.915318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:45.027757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:45.027892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:45.221028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:45.475850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:45.476006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:45.587563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:45.587773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:45.801984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:46.061832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:46.062248 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:46.165087 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:46.165242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:46.344742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:46.583113 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:46.583287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:46.686140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:46.686327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:46.861226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:47.123375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:47.123375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:47.247294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:47.247465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:47.432640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:47.691168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:47.691322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:47.793896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:47.794004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:47.973589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:48.229792 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:48.230314 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:48.339330 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:48.339567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:48.533320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:48.811377 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:48.811557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:48.914552 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:48.914710 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:49.022488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:49.150616 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:49.150777 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:49.215821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:49.215992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:49.223692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:34:49.229637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:34:49.229825 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:34:49.233548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:34:49.233701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:34:49.236779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:34:49.237015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:34:49.301268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:34:49.302068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _write_metadata started, container name: volumebackups, metadata filename: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:34:49.331928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9a8bbc70-ad9a-4de5-8ddc-88a314021746",\n "backup_name": "tempest-type-Backup-714058076",\n "created_at": "2026-07-03 02:34:34+00:00",\n "objects": [\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "ee68f692-7bcb-4246-978e-37cd7a9bad6e",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"ee68f692-7bcb-4246-978e-37cd7a9bad6e\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f7487651cef4420bbe5cfa1b79bb7397\\", \\"project_id\\": \\"6c90b1bb0321472f882a7536b522b9e0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:34:33.000000\\", \\"launched_at\\": \\"2026-07-03T02:34:33.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-150776913\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:34:33.000000\\", \\"updated_at\\": \\"2026-07-03T02:34:34.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:34:49.337581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] backup 9a8bbc70-ad9a-4de5-8ddc-88a314021746 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:34:49.469745 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:49.488329 np0000004352 sudo[144663]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 02:34:49.489147 np0000004352 sudo[144663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:49.580484 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Create backup started, backup: 8b76accb-7d09-41e6-aee6-18da67c2b745 volume: 6b4ea115-40ee-4d4f-b074-6d29d4536ad6. Jul 03 02:34:49.587749 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:34:49Z,data_timestamp=2026-07-03T02:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-backup-280090853',encryption_key_id=None,fail_reason=None,host='np0000004352',id=8b76accb-7d09-41e6-aee6-18da67c2b745,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='367f50a8868f4d07bf688b94c9cd7544',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c53633eed51f4fa7bcee0831b8ab6000',volume_id=6b4ea115-40ee-4d4f-b074-6d29d4536ad6) Jul 03 02:34:49.611392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_367f50a8868f4d07bf688b94c9cd7544 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:49.611591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:49.611918 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:49.623969 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:34:49.642025 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:49.651116 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:34:49.651296 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:34:49.658429 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:34:49.659487 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:fe4b:bbf2', 'fe80::fc16:3eff:febc:5e34', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:feb7:5810', 'fe80::e892:ebff:fe32:961e'] Jul 03 02:34:49.659623 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:34:49.659892 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:34:49.660001 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] <== get_connector_properties: return (48ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:49.790167 np0000004352 sudo[144663]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:49.791923 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.322s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:49.792470 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799090', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:49.792642 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:49.793090 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:49.793409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ee68f692-7bcb-4246-978e-37cd7a9bad6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:34:49.803456 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:49.803978 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:34:49.803978 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:34:49.803978 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:34:49.803978 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e (non-flash) Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:49.824106 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d (non-flash) Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e (non-flash) Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:49.824280 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:49.824505 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-85370bf8-f592-4145-a145-fd9bf5d5029d', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0', '78')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:34:49.824675 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e', '134')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:34:49.825739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x783584b52ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e'): ({'sdc'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:34:49.825935 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sdc {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:34:49.835770 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sdc {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:34:49.843569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:34:49.900756 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:34:49.900900 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:34:49.901817 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:34:49.912199 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:34:49.912511 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:34:49.923715 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:49.955607 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e, portal: 192.168.40.100,3260] Jul 03 02:34:49.955607 np0000004352 cinder-backup[101397]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-ee68f692-7bcb-4246-978e-37cd7a9bad6e, portal: 192.168.40.100,3260] successful. Jul 03 02:34:49.955607 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:49.969301 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:49.969552 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.176s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:49.969685 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (177ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:50.163951 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:34:50.164416 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:50.164643 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:51.013411 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:51.046508 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6386a1af-53dd-48d4-993b-7ea37099cedd tempest-ProjectAdminTests33-230920511 None] Create backup finished. backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746. Jul 03 02:34:51.857723 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e2e0fbaa-903b-45d1-a72a-cf06924fedd4 tempest-ProjectAdminTests33-230920511 None] Export record started, backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746. Jul 03 02:34:51.860370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e2e0fbaa-903b-45d1-a72a-cf06924fedd4 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:51.860603 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e2e0fbaa-903b-45d1-a72a-cf06924fedd4 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:51.860886 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e2e0fbaa-903b-45d1-a72a-cf06924fedd4 tempest-ProjectAdminTests33-230920511 None] Export record finished, backup 9a8bbc70-ad9a-4de5-8ddc-88a314021746 exported. Jul 03 02:34:52.463946 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3cd6a7b5-6217-429b-8a00-7b70856dca18 tempest-ProjectAdminTests33-230920511 None] Import record started, backup_url: eyJkcml2ZXJfaW5mbyI6IHt9LCAiaWQiOiAiYzdkZDRiZTktMmE1OS00MDEyLWE4OGUtOTY2MjIxNGUyM2NlIiwgInVzZXJfaWQiOiAiZjc0ODc2NTFjZWY0NDIwYmJlNWNmYTFiNzliYjczOTciLCAicHJvamVjdF9pZCI6ICI2YzkwYjFiYjAzMjE0NzJmODgyYTc1MzZiNTIyYjllMCIsICJ2b2x1bWVfaWQiOiAiZWU2OGY2OTItN2JjYi00MjQ2LTk3OGUtMzdjZDdhOWJhZDZlIiwgImhvc3QiOiAibnAwMDAwMDA0MzUyIiwgImF2YWlsYWJpbGl0eV96b25lIjogIm5vdmEiLCAiY29udGFpbmVyIjogInZvbHVtZWJhY2t1cHMiLCAicGFyZW50X2lkIjogbnVsbCwgInN0YXR1cyI6ICJhdmFpbGFibGUiLCAiZmFpbF9yZWFzb24iOiBudWxsLCAic2l6ZSI6IDEsICJkaXNwbGF5X25hbWUiOiAidGVtcGVzdC10eXBlLUJhY2t1cC03MTQwNTgwNzYiLCAiZGlzcGxheV9kZXNjcmlwdGlvbiI6IG51bGwsICJzZXJ2aWNlX21ldGFkYXRhIjogInZvbHVtZV9lZTY4ZjY5Mi03YmNiLTQyNDYtOTc4ZS0zN2NkN2E5YmFkNmUvMjAyNjA3MDMwMjM0MzcvYXpfbm92YV9iYWNrdXBfOWE4YmJjNzAtYWQ5YS00ZGU1LThkZGMtODhhMzE0MDIxNzQ2IiwgInNlcnZpY2UiOiAiY2luZGVyLmJhY2t1cC5kcml2ZXJzLnN3aWZ0LlN3aWZ0QmFja3VwRHJpdmVyIiwgIm9iamVjdF9jb3VudCI6IDIxLCAidGVtcF92b2x1bWVfaWQiOiBudWxsLCAidGVtcF9zbmFwc2hvdF9pZCI6IG51bGwsICJudW1fZGVwZW5kZW50X2JhY2t1cHMiOiAwLCAic25hcHNob3RfaWQiOiBudWxsLCAiZGF0YV90aW1lc3RhbXAiOiAiMjAyNi0wNy0wM1QwMjozNDozNFoiLCAicmVzdG9yZV92b2x1bWVfaWQiOiBudWxsLCAibWV0YWRhdGEiOiB7fSwgImVuY3J5cHRpb25fa2V5X2lkIjogbnVsbCwgImNyZWF0ZWRfYXQiOiAiMjAyNi0wNy0wM1QwMjozNDozNFoiLCAidXBkYXRlZF9hdCI6ICIyMDI2LTA3LTAzVDAyOjM0OjUxWiIsICJkZWxldGVkX2F0IjogbnVsbCwgImRlbGV0ZWQiOiBmYWxzZX0=. Jul 03 02:34:52.465229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3cd6a7b5-6217-429b-8a00-7b70856dca18 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:52.465229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3cd6a7b5-6217-429b-8a00-7b70856dca18 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:52.496897 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3cd6a7b5-6217-429b-8a00-7b70856dca18 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:52.516641 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3cd6a7b5-6217-429b-8a00-7b70856dca18 tempest-ProjectAdminTests33-230920511 None] Import record id c7dd4be9-2a59-4012-a88e-9662214e23ce metadata from driver finished. Jul 03 02:34:53.334994 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.170s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:53.335349 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:34:53.346205 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:53.346636 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:53.347210 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:53.357175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:34:53.357175 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6] added Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:53.368447 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:53.368624 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:34:53.368934 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:34:53.369118 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:34:53.535394 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: c7dd4be9-2a59-4012-a88e-9662214e23ce. Jul 03 02:34:53.539326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:53.540058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:53.540353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] delete started, backup: c7dd4be9-2a59-4012-a88e-9662214e23ce, container: volumebackups, prefix: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:34:53.588072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00001', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00002', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00003', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00004', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00005', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00006', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00007', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00008', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00009', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00010', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00011', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00012', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00013', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00014', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00015', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00016', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00017', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00018', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00019', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00020', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00021', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_metadata', 'volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:34:53.609266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.636941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.655757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.676028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.699499 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.726573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.750193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.771765 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.800491 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.836556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.858233 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.876441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.898718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.918770 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.937155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.959430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.978383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:53.996845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.016243 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.041192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.063933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.086103 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.110379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] deleted object: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:34:54.110709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] delete c7dd4be9-2a59-4012-a88e-9662214e23ce finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:34:54.147462 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:54.167885 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] Created reservations ['164d1741-3e79-48d5-b4da-c5cca00b3f39', '2edb2c5d-b31b-49e9-977a-41eca98538f0'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:34:54.186045 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-5f7a2fbc-3e72-4b06-a2dd-405da129a7d4 tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup c7dd4be9-2a59-4012-a88e-9662214e23ce deleted. Jul 03 02:34:54.370536 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:34:54.382172 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:54.392912 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.406682 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:54.447869 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6, portal: 192.168.40.100,3260] Jul 03 02:34:54.447869 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6, portal: 192.168.40.100,3260] successful. Jul 03 02:34:54.447869 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:54.458139 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.471314 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:54.471553 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:54.471682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:54.471807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:34:54.472549 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] HCTL ('11', '-', '-', 0) found on session 139 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:34:54.472720 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:34:54.486085 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Searching for a device in session 139 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:34:54.486085 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:34:55.488050 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.153s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:55.488568 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] <== connect_volume: return (5323ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799096', 'path': '/dev/sdf'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:55.488568 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:55.504508 np0000004352 sudo[145017]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 02:34:55.505203 np0000004352 sudo[145017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:34:55.845337 np0000004352 sudo[145017]: pam_unix(sudo:session): session closed for user root Jul 03 02:34:55.847478 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.358s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:34:55.856070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _create_container started, container: volumebackups,backup: 8b76accb-7d09-41e6-aee6-18da67c2b745. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:34:55.941275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] generate_object_name_prefix: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:34:55.947766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] starting backup of volume: 6b4ea115-40ee-4d4f-b074-6d29d4536ad6, volume size: 1073741824, object names prefix volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:34:56.194708 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:56.920462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:56.920884 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:57.083504 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Create backup started, backup: 437e7371-b6cf-41af-a477-a713664ad83b volume: 0fc3a6a1-58c9-452c-a62c-426d7e64fc97. Jul 03 02:34:57.089469 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:34:57Z,data_timestamp=2026-07-03T02:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-2121570621',encryption_key_id=None,fail_reason=None,host='np0000004352',id=437e7371-b6cf-41af-a477-a713664ad83b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='6c90b1bb0321472f882a7536b522b9e0',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='f7487651cef4420bbe5cfa1b79bb7397',volume_id=0fc3a6a1-58c9-452c-a62c-426d7e64fc97) Jul 03 02:34:57.118548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:34:57.118696 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:34:57.119243 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:57.130472 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:34:57.154346 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:34:57.165696 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:57.166002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:57.210490 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:34:57.211523 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:34:57.220762 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:34:57.221837 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe4b:d44f', 'fe80::bcc7:1dff:fe91:69da', 'fe80::fc16:3eff:fe8a:5e6e', 'fe80::fc16:3eff:feb7:5810', 'fe80::e892:ebff:fe32:961e'] Jul 03 02:34:57.222066 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:34:57.222175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:34:57.222552 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:34:57.225386 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:34:57.479740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:57.728503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:34:57.728503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:34:57.728503 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:57.732833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:57.732981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:57.839166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:57.839434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:58.032207 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:58.312394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:58.312593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:58.423755 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003: a35891500449df17e893f84bd88472fb {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:58.423924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:58.637392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:58.685998 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.958s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:58.686331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:34:58.697448 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:34:58.697961 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:34:58.698285 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:58.708867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:34:58.708867 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97] added Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:34:58.719430 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:58.719696 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:34:58.720086 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:34:58.720282 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:34:58.892225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:58.892535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:58.993982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:58.994185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:59.182106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:59.429232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:34:59.429378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:34:59.530326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:34:59.530493 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:34:59.721500 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:34:59.732549 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:59.744327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:34:59.744809 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.758297 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.758496 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:59.793866 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97, portal: 192.168.40.100,3260] Jul 03 02:34:59.793866 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97, portal: 192.168.40.100,3260] successful. Jul 03 02:34:59.793866 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:59.804478 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.819139 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06362ad6-6e11-4297-9cd8-e5aa60ad7cc6 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c852796b-2802-425d-b47f-15d4bf42032d (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7363cfb-bc13-49a2-a2b6-70aa0684fee0 (non-flash) Jul 03 02:34:59.819413 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:34:59.819701 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:34:59.819701 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:34:59.820691 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] HCTL ('14', '-', '-', 0) found on session 142 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:34:59.820835 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Scanning host 14 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:34:59.834843 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 142 and hctl ['14', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:00.002579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:00.002579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:00.104719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:00.104719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:00.288676 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:00.546769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:00.546996 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:00.651873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:00.652002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:00.835833 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 142 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:00.836123 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:35:00.837018 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:00.837214 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (3108ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799102', 'path': '/dev/sdi'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:00.837595 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:00.847141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:00.856040 np0000004352 sudo[145294]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi Jul 03 02:35:00.856665 np0000004352 sudo[145294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:01.111787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:01.112006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:01.200284 np0000004352 sudo[145294]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:01.202631 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdi" returned: 0 in 0.365s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:01.214573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _create_container started, container: volumebackups,backup: 437e7371-b6cf-41af-a477-a713664ad83b. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:35:01.235230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:01.235401 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:01.244854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] generate_object_name_prefix: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:35:01.254747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] starting backup of volume: 0fc3a6a1-58c9-452c-a62c-426d7e64fc97, volume size: 1073741824, object names prefix volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:35:01.548526 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:01.549357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:01.794890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:01.794890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:01.856970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:01.857582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:01.909845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:01.909845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:01.957705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:01.957873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:02.198833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:02.227863 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:02.438973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:02.439122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:02.472940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:02.474841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:02.560279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:02.560930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:02.583681 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:02.583839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:02.864269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:02.877021 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:03.056769 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:35:03.057374 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:35:03.123217 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:03.123333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:03.151838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:03.151838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:03.231479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:03.231549 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:03.261300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:03.261300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:03.531087 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:03.541439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:03.785861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:03.786222 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:03.800983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:03.801159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:03.891743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:03.891892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:03.930786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:03.930944 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:04.178579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:04.193049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:04.435530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:04.435737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:04.460556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:04.460735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:04.549529 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:04.549734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:04.577018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:04.577223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:04.840160 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:04.856477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:05.101404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:05.101649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:05.108402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:05.108619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:05.205500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:05.205678 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:05.209077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:05.209259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:05.544130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:05.545365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:05.791880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:05.792040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:05.802347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:05.802347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:05.895728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:05.896097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:05.918998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:05.920105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:06.180995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:06.202660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:06.430496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:06.430496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:06.457301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:06.457490 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:06.538171 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:06.538352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:06.562406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:06.562585 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:06.819983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:06.839163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:07.078257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:07.078647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:07.101069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:07.101290 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:07.185894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:07.185999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:07.229646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:07.229971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:07.491934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:07.520126 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:07.746221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:07.746325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:07.779616 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:07.779788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:07.853028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:07.853279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:07.885584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:07.885816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:08.162664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:08.193179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:08.435938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:08.436077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:08.438911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:08.439231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:08.541807 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:08.541977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:08.543096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:08.543247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:08.856686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:08.857912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:09.108008 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:09.108191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:09.108268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:09.108388 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:09.222393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:09.222993 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:09.224675 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:09.224821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:09.370197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:09.468865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:09.496304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:09.496406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:09.563983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup MD5 for volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:09.564165 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:09.572968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:35:09.582342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:35:09.582927 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:35:09.588940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:35:09.589833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:35:09.594450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 02:35:09.594450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:35:09.657034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:35:09.657795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _write_metadata started, container name: volumebackups, metadata filename: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:35:09.695801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "8b76accb-7d09-41e6-aee6-18da67c2b745",\n "backup_name": "tempest-TestVolumeBackupRestore-backup-280090853",\n "created_at": "2026-07-03 02:34:50+00:00",\n "objects": [\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6b4ea115-40ee-4d4f-b074-6d29d4536ad6",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6b4ea115-40ee-4d4f-b074-6d29d4536ad6\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c53633eed51f4fa7bcee0831b8ab6000\\", \\"project_id\\": \\"367f50a8868f4d07bf688b94c9cd7544\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:34:49.000000\\", \\"launched_at\\": \\"2026-07-03T02:34:49.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-TestVolumeBackupRestore-volume-303604426\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:34:48.000000\\", \\"updated_at\\": \\"2026-07-03T02:34:50.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"ea993fc3-c724-45f7-8dae-63cf2cac16e5\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:35:09.708702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] backup 8b76accb-7d09-41e6-aee6-18da67c2b745 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:35:09.839182 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:09.848053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:09.848582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:09.861163 np0000004352 sudo[145766]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 02:35:09.861870 np0000004352 sudo[145766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:09.953884 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:09.954047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:10.150545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:10.228714 np0000004352 sudo[145766]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:10.230620 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.391s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:10.231236 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799096', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:10.231459 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:10.411958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:10.412074 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:10.519882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:10.520061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:10.704254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:10.955613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:10.955906 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:11.055810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:11.055810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:11.264097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:11.534066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:11.534328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:11.643296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:11.643560 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:11.866281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:12.123783 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:12.123955 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:12.227003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:12.227187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:12.435404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:12.680607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:12.680804 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:12.781472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:12.781472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:13.004315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:13.249758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:13.249926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:13.347776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:13.347923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:13.523780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:13.773002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:13.773115 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:13.873231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:13.873520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:13.965971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:14.080296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:14.080758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:14.143539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup MD5 for volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:14.143748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:14.150299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:35:14.155932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:35:14.156065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:35:14.159657 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:35:14.159861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:35:14.162742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:35:14.162952 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:35:14.217199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:35:14.217930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _write_metadata started, container name: volumebackups, metadata filename: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:35:14.242950 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "437e7371-b6cf-41af-a477-a713664ad83b",\n "backup_name": "tempest-type-Backup-2121570621",\n "created_at": "2026-07-03 02:34:57+00:00",\n "objects": [\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0fc3a6a1-58c9-452c-a62c-426d7e64fc97",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0fc3a6a1-58c9-452c-a62c-426d7e64fc97\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"f7487651cef4420bbe5cfa1b79bb7397\\", \\"project_id\\": \\"6c90b1bb0321472f882a7536b522b9e0\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:34:56.000000\\", \\"launched_at\\": \\"2026-07-03T02:34:56.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1199537520\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:34:56.000000\\", \\"updated_at\\": \\"2026-07-03T02:34:57.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:35:14.250518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] backup 437e7371-b6cf-41af-a477-a713664ad83b finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:35:14.371663 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:14.386575 np0000004352 sudo[145983]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi Jul 03 02:35:14.387202 np0000004352 sudo[145983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:14.722629 np0000004352 sudo[145983]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:14.725230 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdi" returned: 0 in 0.353s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:14.725908 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799102', 'path': '/dev/sdi'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:14.725908 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:15.282807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.051s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:15.283260 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.294077 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:15.294923 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:35:15.294923 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:35:15.294923 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:35:15.294923 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.314893 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.315077 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:15.315298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9', '146')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:35:15.315478 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6', '139')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:35:15.316698 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Resulting device map defaultdict(. at 0x78357a956ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6'): ({'sdf'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:35:15.316967 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Removing single pathed devices sdf {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:35:15.328440 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Flushing IO for device /dev/sdf {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:35:15.335913 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:35:15.389953 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:35:15.390143 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:35:15.391661 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:35:15.402663 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:35:15.402975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:35:15.412843 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.449661 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6, portal: 192.168.40.100,3260] Jul 03 02:35:15.449661 np0000004352 cinder-backup[101397]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-6b4ea115-40ee-4d4f-b074-6d29d4536ad6, portal: 192.168.40.100,3260] successful. Jul 03 02:35:15.449661 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.468951 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.469173 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.187s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:15.469307 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] <== disconnect_volume: return (5237ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:15.470674 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.745s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:15.470982 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:15.482101 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:15.482611 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:35:15.482611 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:35:15.482611 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:35:15.482611 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.510307 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97 (non-flash) Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9 (non-flash) Jul 03 02:35:15.510592 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:15.510800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-50ab2522-45f2-41a5-85c9-b5c154ae1bb9', '146')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:35:15.510800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97', '142')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:35:15.511610 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x78357a81dda0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97'): ({'sdi'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:35:15.511794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sdi {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:35:15.524168 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sdi {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:35:15.532231 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:35:15.590911 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sdi have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:35:15.591145 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] SCSI volumes sdi have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:35:15.592070 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sdi'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:35:15.603445 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Device paths {'sdi'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:35:15.603687 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:35:15.614457 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.648345 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97, portal: 192.168.40.100,3260] Jul 03 02:35:15.648345 np0000004352 cinder-backup[101397]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-0fc3a6a1-58c9-452c-a62c-426d7e64fc97, portal: 192.168.40.100,3260] successful. Jul 03 02:35:15.648345 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.664630 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:15.664899 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.194s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:15.665029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (939ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:16.515026 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-63c89031-ede6-4f17-b0f8-0de69e8d81c8 tempest-TestVolumeBackupRestore-1703538957 None] Create backup finished. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745. Jul 03 02:35:16.696764 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-93a7ebdb-e55f-4a3b-abff-16de7df642d6 tempest-ProjectAdminTests33-230920511 None] Create backup finished. backup: 437e7371-b6cf-41af-a477-a713664ad83b. Jul 03 02:35:17.546027 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1f9c50e4-5225-4718-bf82-e5b9825cf227 tempest-ProjectAdminTests33-230920511 None] Reset backup status started, backup_id: 437e7371-b6cf-41af-a477-a713664ad83b, status: error. Jul 03 02:35:17.546374 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1f9c50e4-5225-4718-bf82-e5b9825cf227 tempest-ProjectAdminTests33-230920511 None] Backup service: cinder.backup.drivers.swift.SwiftBackupDriver. Jul 03 02:35:18.367523 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Restore backup started, backup: 8b76accb-7d09-41e6-aee6-18da67c2b745 volume: ddb51033-b508-45f7-a948-0dc069766659. Jul 03 02:35:18.385622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_367f50a8868f4d07bf688b94c9cd7544 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:18.385803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:18.386101 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:18.396436 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:35:18.416389 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:18.427262 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:35:18.427679 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:35:18.435674 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:35:18.436697 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:a7ce', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe07:98bd', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:35:18.436842 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:35:18.436945 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:35:18.437190 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:19.443409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:35:19.443969 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddb51033-b508-45f7-a948-0dc069766659', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:19.444104 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:19.444655 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:19.444873 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddb51033-b508-45f7-a948-0dc069766659', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:35:19.462245 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:19.462245 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:19.462245 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:19.475048 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:35:19.475048 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659] added Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:19.492975 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:19.493176 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:35:19.493686 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:35:19.493918 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:35:19.816974 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Restore backup started, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. Jul 03 02:35:19.867852 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:19.878711 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:19.878901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:19.879190 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:19.889587 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:35:19.908762 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:19.919681 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:35:19.919965 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:35:19.927856 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:35:19.928827 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:a7ce', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe07:98bd', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:35:19.928967 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:35:19.929077 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:35:19.929299 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:20.494810 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:35:20.506353 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:20.516667 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:20.530009 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.530009 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.530009 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:20.530293 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.530293 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.530293 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:20.574553 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659, portal: 192.168.40.100,3260] Jul 03 02:35:20.574553 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659, portal: 192.168.40.100,3260] successful. Jul 03 02:35:20.574553 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:20.584755 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:20.598300 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.598300 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.598300 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:20.598300 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:20.598499 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.598499 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:20.598499 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:20.598499 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:20.598829 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:20.598956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:35:20.599566 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] HCTL ('7', '-', '-', 0) found on session 147 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:35:20.599738 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:35:20.619932 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:20.949625 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:35:20.950069 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:20.950235 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:21.614703 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:21.615156 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddb51033-b508-45f7-a948-0dc069766659', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:35:21.615432 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.171s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:21.615638 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] <== connect_volume: return (2171ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799111', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:21.615913 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:21.622811 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.671s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:21.623240 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:35:21.632208 np0000004352 sudo[146422]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:35:21.632880 np0000004352 sudo[146422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:21.634736 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:21.635190 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:21.635484 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:21.647121 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:35:21.647121 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8] added Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:21.660754 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:21.661000 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:35:21.661331 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:35:21.661535 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:35:21.964117 np0000004352 sudo[146422]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:21.966003 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.350s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:21.966470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] starting restore of backup volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745 container: volumebackups, to new volume ddb51033-b508-45f7-a948-0dc069766659, backup: 8b76accb-7d09-41e6-aee6-18da67c2b745. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:35:21.966609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] _read_metadata started, container name: volumebackups, metadata filename: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] _read_metadata finished. Metadata: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "backup_id": "8b76accb-7d09-41e6-aee6-18da67c2b745", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "backup_name": "tempest-TestVolumeBackupRestore-backup-280090853", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:34:50+00:00", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021": { Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: } Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: ], Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_id": "6b4ea115-40ee-4d4f-b074-6d29d4536ad6", Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6b4ea115-40ee-4d4f-b074-6d29d4536ad6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c53633eed51f4fa7bcee0831b8ab6000\", \"project_id\": \"367f50a8868f4d07bf688b94c9cd7544\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:34:49.000000\", \"launched_at\": \"2026-07-03T02:34:49.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-303604426\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:34:48.000000\", \"updated_at\": \"2026-07-03T02:34:50.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"ea993fc3-c724-45f7-8dae-63cf2cac16e5\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 02:35:21.984643 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:35:21.993092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:35:21.993092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] _read_metadata started, container name: volumebackups, metadata filename: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] _read_metadata finished. Metadata: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "backup_id": "8b76accb-7d09-41e6-aee6-18da67c2b745", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "backup_name": "tempest-TestVolumeBackupRestore-backup-280090853", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:34:50+00:00", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "82571f7121cb9475563edde615e4e4df", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "a35891500449df17e893f84bd88472fb", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021": { Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: } Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: ], Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_id": "6b4ea115-40ee-4d4f-b074-6d29d4536ad6", Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"6b4ea115-40ee-4d4f-b074-6d29d4536ad6\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"c53633eed51f4fa7bcee0831b8ab6000\", \"project_id\": \"367f50a8868f4d07bf688b94c9cd7544\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:34:49.000000\", \"launched_at\": \"2026-07-03T02:34:49.000000\", \"terminated_at\": null, \"display_name\": \"tempest-TestVolumeBackupRestore-volume-303604426\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": true, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:34:48.000000\", \"updated_at\": \"2026-07-03T02:34:50.000000\"}, \"volume-glance-metadata\": {\"hw_rng_model\": \"virtio\", \"os_glance_failed_import\": \"\", \"os_glance_importing_to_stores\": \"\", \"owner_specified.openstack.md5\": \"\", \"owner_specified.openstack.object\": \"images/cirros-0.6.3-x86_64-disk\", \"owner_specified.openstack.sha256\": \"\", \"image_id\": \"ea993fc3-c724-45f7-8dae-63cf2cac16e5\", \"image_name\": \"cirros-0.6.3-x86_64-disk\", \"checksum\": \"87617e24a5e30cb3b87fda8c0764838f\", \"container_format\": \"bare\", \"disk_format\": \"qcow2\", \"min_disk\": \"0\", \"min_ram\": \"0\", \"size\": \"21692416\"}}" Jul 03 02:35:22.000053 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:35:22.006273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] v1 volume backup restore of 8b76accb-7d09-41e6-aee6-18da67c2b745 started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:35:22.006273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] metadata_object_names = ['volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:35:22.044174 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] generated object list: ['volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:22.078956 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:22.083991 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:22.174713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:22.652068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:22.663148 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:22.670999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:35:22.676023 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:22.688707 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:22.703080 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.703080 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.703080 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:22.703080 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:22.703336 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.703336 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.703336 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:22.703336 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:22.748370 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8, portal: 192.168.40.100,3260] Jul 03 02:35:22.748370 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8, portal: 192.168.40.100,3260] successful. Jul 03 02:35:22.748370 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:22.760798 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:22.776850 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.776850 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.776850 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:22.776850 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:22.776850 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:22.777103 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.777103 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:22.777103 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:22.777103 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:22.777103 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:22.777287 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:22.777477 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:35:22.778399 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] HCTL ('10', '-', '-', 0) found on session 148 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:35:22.778636 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Scanning host 10 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:35:22.793932 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Searching for a device in session 148 and hctl ['10', '*', '*', 0] yield: sde {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:22.794182 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:35:23.023379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:23.052751 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:23.392297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:23.406851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:23.751173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:23.769272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:23.797401 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.176s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:23.797682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] <== connect_volume: return (2846ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799115', 'path': '/dev/sde'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:23.798079 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:23.817823 np0000004352 sudo[146476]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde Jul 03 02:35:23.818528 np0000004352 sudo[146476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:24.125543 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:24.134539 np0000004352 sudo[146476]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:24.136253 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sde" returned: 0 in 0.338s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:24.136612 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] starting restore of backup volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c container: volumebackups, to new volume 0b18af22-29f9-44bf-ad58-01f2d1b31ad8, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:35:24.136762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] _read_metadata started, container name: volumebackups, metadata filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:35:24.145013 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] _read_metadata finished. Metadata: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "backup_id": "980cbedd-d350-43d4-9dd1-0d392b4a142c", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "backup_name": "tempest-type-Backup-1311707960", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:33:31+00:00", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021": { Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: ], Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_id": "8d97939d-3a40-4663-ac5a-481bf03a69fe", Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"8d97939d-3a40-4663-ac5a-481bf03a69fe\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f7487651cef4420bbe5cfa1b79bb7397\", \"project_id\": \"6c90b1bb0321472f882a7536b522b9e0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:33:30.000000\", \"launched_at\": \"2026-07-03T02:33:30.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-848193716\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:33:29.000000\", \"updated_at\": \"2026-07-03T02:33:31.000000\"}}" Jul 03 02:35:24.153651 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:35:24.163238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:35:24.163238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] _read_metadata started, container name: volumebackups, metadata filename: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] _read_metadata finished. Metadata: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "backup_id": "980cbedd-d350-43d4-9dd1-0d392b4a142c", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "backup_name": "tempest-type-Backup-1311707960", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:33:31+00:00", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021": { Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: } Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: ], Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_id": "8d97939d-3a40-4663-ac5a-481bf03a69fe", Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"8d97939d-3a40-4663-ac5a-481bf03a69fe\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"f7487651cef4420bbe5cfa1b79bb7397\", \"project_id\": \"6c90b1bb0321472f882a7536b522b9e0\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#default\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:33:30.000000\", \"launched_at\": \"2026-07-03T02:33:30.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-848193716\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:33:29.000000\", \"updated_at\": \"2026-07-03T02:33:31.000000\"}}" Jul 03 02:35:24.182241 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:35:24.187618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] v1 volume backup restore of 980cbedd-d350-43d4-9dd1-0d392b4a142c started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:35:24.187618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] metadata_object_names = ['volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:35:24.227918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:24.233472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:24.249224 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:24.717091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:24.726728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:24.734340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:24.741080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:25.233623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:25.237192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:25.254608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:25.258297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:25.787940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:25.791736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:25.804778 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:25.805871 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:26.324812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:26.334012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:26.345502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:26.354577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:26.891613 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=141,cinder:UPDATE=37,cinder:INSERT=4 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:35:26.895157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:26.895904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:26.924691 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:26.928970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:27.491471 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:27.496137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:27.509887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:27.514726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:28.063857 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:28.064393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:28.086101 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:28.090006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:28.624032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:28.627819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:28.642104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:28.652724 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:29.167392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:29.167878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:29.188834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:29.190436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:29.723636 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:29.724058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:29.748978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:29.750780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:29.851968 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Create backup started, backup: 875463f0-4778-4f37-8e30-1f36860efb4b volume: 9a32dfc7-0cf2-45b6-86cf-de6e5413731c. Jul 03 02:35:29.859382 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:35:29Z,data_timestamp=2026-07-03T02:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1360722134',encryption_key_id=None,fail_reason=None,host='np0000004352',id=875463f0-4778-4f37-8e30-1f36860efb4b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='adf5b837395b4ec4b4d770e9dfeceefe',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='227bb7cba0d24d769e96a5233803cfac',volume_id=9a32dfc7-0cf2-45b6-86cf-de6e5413731c) Jul 03 02:35:29.886137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_adf5b837395b4ec4b4d770e9dfeceefe {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:29.886633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:29.887073 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:29.899432 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:35:30.274726 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:30.337837 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:35:30.338246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:35:30.345516 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:35:30.346357 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:a7ce', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe07:98bd', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:35:30.346560 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:35:30.346723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:35:30.347000 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] <== get_connector_properties: return (459ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:30.350940 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:30.356277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:30.356953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:30.376771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:30.381440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:30.875970 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:35:30.876394 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:30.876585 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:30.876931 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:30.877148 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:35:30.883212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:30.883859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:30.889596 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:30.889922 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:30.890127 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:30.900178 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:35:30.900178 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:30.905289 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:30.908892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c] added Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:30.912071 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:30.912258 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:35:30.912672 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0224(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:35:30.912902 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:35:31.413918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:31.414453 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:31.431686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:31.437003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:31.965447 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:31.971888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:31.972274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:35:31.978048 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:31.990793 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:31.994595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:31.996748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:32.013823 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.013823 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.013823 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:32.013823 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:32.013823 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:32.014047 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.014047 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.014047 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:32.014047 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:32.014047 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:32.055073 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c, portal: 192.168.40.100,3260] Jul 03 02:35:32.055073 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c, portal: 192.168.40.100,3260] successful. Jul 03 02:35:32.055073 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:32.067328 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:32.084552 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:32.084764 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:32.085061 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:32.085348 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:35:32.086182 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] HCTL ('11', '-', '-', 0) found on session 149 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:35:32.086339 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:35:32.102600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Searching for a device in session 149 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:32.102600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:35:32.559580 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:32.563676 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restoring object. backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, object name: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021, volume: ddb51033-b508-45f7-a948-0dc069766659. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:32.579957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:32.583970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:32.974714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] v1 volume backup restore of 8b76accb-7d09-41e6-aee6-18da67c2b745 finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:35:32.975260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:35:32.983811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:32.993617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:35:32.993617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Restoring volume glance metadata {{(pid=101397) _restore_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:258}} Jul 03 02:35:33.007851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:33.103122 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.226s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:33.103313 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] <== connect_volume: return (2226ms) {'type': 'block', 'scsi_wwn': '33000000026abaf3a', 'path': '/dev/sdf'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:33.103698 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:33.121325 np0000004352 sudo[146578]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 02:35:33.121927 np0000004352 sudo[146578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:33.166055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] restore 8b76accb-7d09-41e6-aee6-18da67c2b745 to ddb51033-b508-45f7-a948-0dc069766659 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:35:33.174180 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:33.190850 np0000004352 sudo[146580]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:35:33.191457 np0000004352 sudo[146580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:33.425620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:33.444796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:33.469157 np0000004352 sudo[146578]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:33.470878 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.367s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:33.478685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _create_container started, container: volumebackups,backup: 875463f0-4778-4f37-8e30-1f36860efb4b. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:35:33.524948 np0000004352 sudo[146580]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:33.526779 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.353s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:33.527248 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddb51033-b508-45f7-a948-0dc069766659', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799111', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:33.527479 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:33.527938 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:33.528299 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ddb51033-b508-45f7-a948-0dc069766659', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:33.539901 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:33.540580 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:35:33.540580 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:35:33.540580 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:35:33.540580 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:33.563644 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:33.563877 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:33.564012 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', '149')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:35:33.564012 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '147')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:35:33.564855 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Resulting device map defaultdict(. at 0x783584c02ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:35:33.565046 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:35:33.574674 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:35:33.581871 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:35:33.662068 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:35:33.662260 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:35:33.663267 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:35:33.799361 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:35:33.799915 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:35:33.807383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:33.816715 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:33.825820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:33.851605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659, portal: 192.168.40.100,3260] Jul 03 02:35:33.851605 np0000004352 cinder-backup[101397]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659, portal: 192.168.40.100,3260] successful. Jul 03 02:35:33.851605 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:33.859557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] generate_object_name_prefix: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:35:33.864437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] starting backup of volume: 9a32dfc7-0cf2-45b6-86cf-de6e5413731c, volume size: 1073741824, object names prefix volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:35:33.866266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:33.866517 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:33.866653 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] <== disconnect_volume: return (339ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:34.205718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:34.221257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:34.241895 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:34.543789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:34.543914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:34.549484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restoring object. backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, object name: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021, volume: 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:35:34.566637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:35:34.742958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:34.743183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:34.746535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] v1 volume backup restore of 980cbedd-d350-43d4-9dd1-0d392b4a142c finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:35:34.746784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:35:34.753505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Excluding field 'display_name' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:35:34.753505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Excluding field 'display_description' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:35:34.758707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:35:34.758871 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:35:34.759051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] restore 980cbedd-d350-43d4-9dd1-0d392b4a142c to 0b18af22-29f9-44bf-ad58-01f2d1b31ad8 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:35:34.759433 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:34.782719 np0000004352 sudo[146638]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde Jul 03 02:35:34.783543 np0000004352 sudo[146638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:34.883315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Encryption key ID for volume ddb51033-b508-45f7-a948-0dc069766659 already matches encryption key ID in backup 8b76accb-7d09-41e6-aee6-18da67c2b745. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:35:34.926458 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-982f5e0e-6023-419a-898d-426107ef8425 tempest-TestVolumeBackupRestore-1703538957 None] Finished restoring backup 8b76accb-7d09-41e6-aee6-18da67c2b745 to volume ddb51033-b508-45f7-a948-0dc069766659. Jul 03 02:35:34.990958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:35.122198 np0000004352 sudo[146638]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:35.123879 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sde" returned: 0 in 0.364s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:35.124311 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799115', 'path': '/dev/sde'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:35.124508 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:35.124913 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:35.125202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:35.137277 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:35.137966 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:35:35.137966 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:35:35.137966 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:35:35.137966 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:35:35.165749 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:35.165749 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:35.165749 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:35.165749 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:35.165749 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:35.165950 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:35.165950 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:35.165950 np0000004352 cinder-backup[101397]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8 (non-flash) Jul 03 02:35:35.165950 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:35.165950 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:35.166095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', '149')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:35:35.166257 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8', '148')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:35:35.167180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Resulting device map defaultdict(. at 0x78357a868220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8'): ({'sde'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:35:35.167480 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Removing single pathed devices sde {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:35:35.183021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Flushing IO for device /dev/sde {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:35:35.194825 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:35:35.248084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Checking to see if SCSI volumes sde have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:35:35.248084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] SCSI volumes sde have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:35:35.249013 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Checking to see if device paths {'sde'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:35:35.251016 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:35.251016 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:35.259876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Device paths {'sde'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:35:35.260159 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:35:35.270270 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:35.304731 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8, portal: 192.168.40.100,3260] Jul 03 02:35:35.304731 np0000004352 cinder-backup[101397]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-0b18af22-29f9-44bf-ad58-01f2d1b31ad8, portal: 192.168.40.100,3260] successful. Jul 03 02:35:35.304731 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:35.319900 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:35.320150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:35.320266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] <== disconnect_volume: return (195ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:35.359273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:35.359501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:35.559335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:35.808130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:35.808766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:35.911797 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:35.912237 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:36.136205 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:36.330808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Encryption key ID for volume 0b18af22-29f9-44bf-ad58-01f2d1b31ad8 already matches encryption key ID in backup 980cbedd-d350-43d4-9dd1-0d392b4a142c. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:35:36.348499 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d904d240-4c21-4bc0-826c-76cc0afbe50a tempest-ProjectAdminTests33-230920511 None] Finished restoring backup 980cbedd-d350-43d4-9dd1-0d392b4a142c to volume 0b18af22-29f9-44bf-ad58-01f2d1b31ad8. Jul 03 02:35:36.388839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:36.388975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:36.494966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:36.494966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:36.698841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:36.945050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:36.945192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:37.050350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:37.050542 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:37.274958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:37.522513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:37.522960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:37.635513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:37.635703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:37.845582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:38.102442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:38.102665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:38.213708 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:38.214034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:38.394412 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: 437e7371-b6cf-41af-a477-a713664ad83b. Jul 03 02:35:38.403295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:38.403539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:38.403711 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] delete started, backup: 437e7371-b6cf-41af-a477-a713664ad83b, container: volumebackups, prefix: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:35:38.466508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00001', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00002', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00003', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00004', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00005', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00006', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00007', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00008', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00009', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00010', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00011', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00012', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00013', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00014', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00015', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00016', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00017', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00018', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00019', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00020', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00021', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_metadata', 'volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:38.473413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:38.488743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.520703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.544880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.578650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.601740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.630541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.660217 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.685590 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.712989 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.735975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.743624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:38.743795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:38.756488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.779483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.800382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.821185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.844928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.856460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:38.856460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:38.900168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.912600 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:38.945150 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:38.975430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.008369 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.039482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.078926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.107929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.126175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] deleted object: volume_0fc3a6a1-58c9-452c-a62c-426d7e64fc97/20260703023501/az_nova_backup_437e7371-b6cf-41af-a477-a713664ad83b_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:39.126484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] delete 437e7371-b6cf-41af-a477-a713664ad83b finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:35:39.130634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:39.140979 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] Created reservations ['bbcdebed-c5f9-426f-ba74-0b1bd7a703ff', '2db7615b-48b1-44ea-9341-81d3dbfa13f9'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:35:39.166141 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-cbf91786-bd2b-4d46-962b-03a4fe70834f tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup 437e7371-b6cf-41af-a477-a713664ad83b deleted. Jul 03 02:35:39.404386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:39.404517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:39.485188 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746. Jul 03 02:35:39.488903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:39.489148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:39.489324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] delete started, backup: 9a8bbc70-ad9a-4de5-8ddc-88a314021746, container: volumebackups, prefix: volume_ee68f692-7bcb-4246-978e-37cd7a9bad6e/20260703023437/az_nova_backup_9a8bbc70-ad9a-4de5-8ddc-88a314021746. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:35:39.518527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] generated object list: []. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:39.518527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] delete 9a8bbc70-ad9a-4de5-8ddc-88a314021746 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:35:39.548409 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:39.548875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:39.581204 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:39.605538 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] Created reservations ['07156d60-9f90-4d52-b42e-84fd45245c09', '3794ba09-8b13-48d3-b1e2-6ec901d5022f'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:35:39.646903 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e093d274-7467-4dab-a248-d8c3eab3e617 tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup 9a8bbc70-ad9a-4de5-8ddc-88a314021746 deleted. Jul 03 02:35:39.816199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:40.079890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:40.080036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:40.190009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:40.190280 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:40.415345 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:40.569468 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] Delete backup started, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c. Jul 03 02:35:40.576141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_6c90b1bb0321472f882a7536b522b9e0 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:40.576141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:40.576141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] delete started, backup: 980cbedd-d350-43d4-9dd1-0d392b4a142c, container: volumebackups, prefix: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:35:40.611091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] generated object list: ['volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata', 'volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:40.636413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.658728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.672648 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:40.673088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:40.686522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.711938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.745208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.765591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.791651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.796855 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:40.797003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:40.830562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.840341 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:40.854994 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.898077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.939484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.963712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:40.985976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.015362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.039140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.059953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.070615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:41.080715 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.102596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.131896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.153752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.174793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.198756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.225528 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] deleted object: volume_8d97939d-3a40-4663-ac5a-481bf03a69fe/20260703023334/az_nova_backup_980cbedd-d350-43d4-9dd1-0d392b4a142c_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:41.225957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] delete 980cbedd-d350-43d4-9dd1-0d392b4a142c finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:35:41.241493 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] Created reservations ['f02a601b-267c-4a55-a82e-41b60b36501e', '0b4bb703-373f-48a1-996d-36c8b004b1ee'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:35:41.261445 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2c018608-87c8-483b-a7f1-a86ba7cd7b9d tempest-ProjectAdminTests33-230920511 None] Delete backup finished, backup 980cbedd-d350-43d4-9dd1-0d392b4a142c deleted. Jul 03 02:35:41.367650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:41.367799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:41.497012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:41.497193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:41.688055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:42.009290 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:42.009561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:42.115207 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:42.115392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:42.332897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:42.589624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:42.589849 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:42.701271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:42.701704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:42.935612 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:43.241297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:43.241297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:43.361764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:43.361982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:43.600696 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:43.869795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:43.870185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:43.990936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:43.991059 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:44.226109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:44.499080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:44.499235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:44.609807 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:44.609958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:44.823393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:45.084101 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:45.084642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:45.201240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:45.201453 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:45.417898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:45.693139 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:45.693722 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:45.798009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:45.798140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:45.985376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:46.226935 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Create backup started, backup: 6bdd7c04-1a0f-4b84-b920-56964580de6c volume: 5b14a554-ae2d-43d5-b402-740f38d2b791. Jul 03 02:35:46.229862 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:46.230031 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:46.232829 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:35:46Z,data_timestamp=2026-07-03T02:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-499122867',encryption_key_id=None,fail_reason=None,host='np0000004352',id=6bdd7c04-1a0f-4b84-b920-56964580de6c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0bd417b090dd4956b0338a9a85d40867',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1c087ae6e097461883273610d71adcd5',volume_id=5b14a554-ae2d-43d5-b402-740f38d2b791) Jul 03 02:35:46.268018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:46.268018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:46.268018 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:46.278777 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:35:46.299672 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:46.312929 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:35:46.313182 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:35:46.326400 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:35:46.327393 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:a7ce', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe07:98bd', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:35:46.327535 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:35:46.327652 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:35:46.327897 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:46.370182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:46.370333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:46.416133 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:46.542461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:46.668539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:46.668692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:46.736190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup MD5 for volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:46.736378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:46.743600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:35:46.749328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:35:46.749503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:35:46.753756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:35:46.753756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:35:46.756787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:35:46.757001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:35:46.821501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:35:46.822291 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _write_metadata started, container name: volumebackups, metadata filename: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:35:46.832042 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:35:46.832570 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b14a554-ae2d-43d5-b402-740f38d2b791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:46.832828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:46.852127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "875463f0-4778-4f37-8e30-1f36860efb4b",\n "backup_name": "tempest-type-Backup-1360722134",\n "created_at": "2026-07-03 02:35:30+00:00",\n "objects": [\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "9a32dfc7-0cf2-45b6-86cf-de6e5413731c",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"9a32dfc7-0cf2-45b6-86cf-de6e5413731c\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"227bb7cba0d24d769e96a5233803cfac\\", \\"project_id\\": \\"adf5b837395b4ec4b4d770e9dfeceefe\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:35:29.000000\\", \\"launched_at\\": \\"2026-07-03T02:35:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1168064527\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:35:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:35:30.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:35:46.857564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] backup 875463f0-4778-4f37-8e30-1f36860efb4b finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:35:46.981907 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:46.997759 np0000004352 sudo[146726]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 02:35:46.998401 np0000004352 sudo[146726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:47.313158 np0000004352 sudo[146726]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:47.315565 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.333s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:47.316260 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000026abaf3a', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:35:47.316498 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:49.722410 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.889s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:49.722847 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b14a554-ae2d-43d5-b402-740f38d2b791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:35:49.732363 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:35:49.732739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:49.732934 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:49.741760 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:35:49.741760 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791] added Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:49.752449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:35:49.752726 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0194(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:35:49.752849 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:35:50.754213 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:35:50.765794 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:50.777188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.792632 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.792982 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:50.835284 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791, portal: 192.168.40.100,3260] Jul 03 02:35:50.835284 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791, portal: 192.168.40.100,3260] successful. Jul 03 02:35:50.835284 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:50.845347 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:35:50.859394 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:35:50.859764 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:50.859933 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:50.860037 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:35:50.860781 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] HCTL ('12', '-', '-', 0) found on session 152 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:35:50.860924 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Scanning host 12 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:35:50.874007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Searching for a device in session 152 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:35:50.874007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b14a554-ae2d-43d5-b402-740f38d2b791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:35:51.875878 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.154s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:51.876326 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] <== connect_volume: return (5043ms) {'type': 'block', 'scsi_wwn': '3300000004f2e0cc1', 'path': '/dev/sdg'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:51.876372 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:35:51.881943 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.565s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:35:51.882708 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:35:51.892618 np0000004352 sudo[146987]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg Jul 03 02:35:51.893537 np0000004352 sudo[146987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:35:51.893896 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:51.894408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:35:51.894408 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:35:51.894408 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:35:51.894408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:35:51.922896 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:35:51.923154 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:35:51.923269 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', '152')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:35:51.923390 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c', '149')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:35:51.924711 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Resulting device map defaultdict(. at 0x78357a906480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c'): ({'sdf'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:35:51.924910 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Removing single pathed devices sdf {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:35:51.937364 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Flushing IO for device /dev/sdf {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:35:51.945051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:35:51.993860 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:35:51.994010 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:35:51.995103 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:35:52.006348 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:35:52.006700 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:35:52.017754 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:52.047439 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c, portal: 192.168.40.100,3260] Jul 03 02:35:52.047439 np0000004352 cinder-backup[101397]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-9a32dfc7-0cf2-45b6-86cf-de6e5413731c, portal: 192.168.40.100,3260] successful. Jul 03 02:35:52.047439 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:52.062058 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:35:52.062353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.181s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:35:52.062538 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] <== disconnect_volume: return (4745ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:35:52.217209 np0000004352 sudo[146987]: pam_unix(sudo:session): session closed for user root Jul 03 02:35:52.219029 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdg" returned: 0 in 0.342s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:35:52.228041 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _create_container started, container: volumebackups,backup: 6bdd7c04-1a0f-4b84-b920-56964580de6c. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:35:52.371306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] generate_object_name_prefix: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:35:52.376943 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] starting backup of volume: 5b14a554-ae2d-43d5-b402-740f38d2b791, volume size: 1073741824, object names prefix volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:35:52.547647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:52.795377 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:52.795577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:52.901479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:52.902011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:53.087851 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-69743033-dd38-44df-aa38-41c11e2ac057 tempest-ProjectMemberTests39-67906101 None] Create backup finished. backup: 875463f0-4778-4f37-8e30-1f36860efb4b. Jul 03 02:35:53.112625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:53.362678 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:53.362864 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:53.474415 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:53.474415 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:53.639747 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] Delete backup started, backup: 875463f0-4778-4f37-8e30-1f36860efb4b. Jul 03 02:35:53.644576 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_adf5b837395b4ec4b4d770e9dfeceefe {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:35:53.644905 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:35:53.645121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] delete started, backup: 875463f0-4778-4f37-8e30-1f36860efb4b, container: volumebackups, prefix: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:35:53.692283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] generated object list: ['volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00001', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00002', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00003', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00004', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00005', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00006', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00007', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00008', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00009', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00010', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00011', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00012', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00013', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00014', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00015', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00016', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00017', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00018', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00019', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00020', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00021', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_metadata', 'volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:35:53.704187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:53.717747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.743620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.766822 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.786309 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.808582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.831366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.855028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.877223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.900399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.925496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.951495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:53.970734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:53.970955 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:53.975575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.003162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.025777 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.045439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.064146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.080086 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:54.080086 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:54.119884 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.130264 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:35:54.145235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.173701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.200356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.224961 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.250266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.272325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] deleted object: volume_9a32dfc7-0cf2-45b6-86cf-de6e5413731c/20260703023533/az_nova_backup_875463f0-4778-4f37-8e30-1f36860efb4b_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:35:54.272636 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] delete 875463f0-4778-4f37-8e30-1f36860efb4b finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:35:54.295333 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] Created reservations ['98b545b5-92dd-45d1-9eac-bed62330ec9f', 'd7365a6b-2ddd-4c98-bfb8-fd1d692143d0'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:35:54.321843 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d2261304-0fa1-4d1c-9d5f-8235a04f27bd tempest-ProjectMemberTests39-67906101 None] Delete backup finished, backup 875463f0-4778-4f37-8e30-1f36860efb4b deleted. Jul 03 02:35:54.338346 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:54.592985 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:54.593154 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:54.709819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:54.710078 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:54.939200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:55.185122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:55.185284 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:55.291308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:55.291535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:55.484310 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:55.745137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:55.745325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:55.853959 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:55.854153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:56.046390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:56.332211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:56.332211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:56.461713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:56.463098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:56.723116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:56.982885 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:56.983069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:57.094399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:57.094781 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:57.306860 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:57.570649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:57.570649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:57.706940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:57.706940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:57.953772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:58.221410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:58.221886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:58.338776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:58.338992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:58.532301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:58.806712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:58.806924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:58.912899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:58.913094 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:59.128971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:35:59.389992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:35:59.390392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:35:59.507808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:35:59.508073 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:35:59.725328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:00.033494 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:00.033651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:00.155962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:00.156146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:00.342104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:00.598850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:00.599186 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:00.723853 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:00.723976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:00.979867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:01.251964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:01.252208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:01.374133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:01.374291 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:01.599070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:01.873698 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:01.873698 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:02.003436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:02.003632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:02.214996 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:02.481074 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:02.481509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:02.600601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:02.600601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:02.823558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:03.060498 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:36:03.060868 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:36:03.089255 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:03.089513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:03.209897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:03.210055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:03.406520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:03.671362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:03.671852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:03.781539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:03.781675 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:03.993308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:04.274436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:04.274635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:04.395532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:04.395682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:04.515565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:04.646891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:04.646891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:04.717180 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:04.717701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:04.727504 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:36:04.735705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:36:04.735946 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:36:04.741856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:36:04.742072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:36:04.746677 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:36:04.747058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:36:04.816192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:36:04.817148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _write_metadata started, container name: volumebackups, metadata filename: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:36:04.853904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "6bdd7c04-1a0f-4b84-b920-56964580de6c",\n "backup_name": "tempest-type-Backup-499122867",\n "created_at": "2026-07-03 02:35:46+00:00",\n "objects": [\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5b14a554-ae2d-43d5-b402-740f38d2b791",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5b14a554-ae2d-43d5-b402-740f38d2b791\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"1c087ae6e097461883273610d71adcd5\\", \\"project_id\\": \\"0bd417b090dd4956b0338a9a85d40867\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:35:45.000000\\", \\"launched_at\\": \\"2026-07-03T02:35:45.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-340539931\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:35:45.000000\\", \\"updated_at\\": \\"2026-07-03T02:35:46.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:36:04.860939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] backup 6bdd7c04-1a0f-4b84-b920-56964580de6c finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:36:05.000684 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:05.022324 np0000004352 sudo[147735]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg Jul 03 02:36:05.023200 np0000004352 sudo[147735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:36:05.386026 np0000004352 sudo[147735]: pam_unix(sudo:session): session closed for user root Jul 03 02:36:05.388372 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdg" returned: 0 in 0.387s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:36:05.389066 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b14a554-ae2d-43d5-b402-740f38d2b791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000004f2e0cc1', 'path': '/dev/sdg'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:05.389298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:08.051126 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.661s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:08.051605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b14a554-ae2d-43d5-b402-740f38d2b791', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:08.064415 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:08.065175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:36:08.065175 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:36:08.065175 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:36:08.065175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:08.088800 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:08.089140 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:08.089294 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b90fa3f-11b6-4c3b-bcf3-18fbd2f5a073', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071', '156')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:36:08.089432 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791', '152')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:36:08.090788 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Resulting device map defaultdict(. at 0x78357a7f7060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791'): ({'sdg'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:36:08.091036 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Removing single pathed devices sdg {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:36:08.101690 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Flushing IO for device /dev/sdg {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:36:08.109168 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:36:08.163507 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Checking to see if SCSI volumes sdg have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:36:08.163507 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] SCSI volumes sdg have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:36:08.163507 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Checking to see if device paths {'sdg'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:36:08.179776 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Device paths {'sdg'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:36:08.179776 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:36:08.201436 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:08.245173 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791, portal: 192.168.40.100,3260] Jul 03 02:36:08.245173 np0000004352 cinder-backup[101397]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-5b14a554-ae2d-43d5-b402-740f38d2b791, portal: 192.168.40.100,3260] successful. Jul 03 02:36:08.245173 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:08.268331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:08.268331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.213s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:08.268331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] <== disconnect_volume: return (2873ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:09.288564 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-c4249491-0554-4330-9ba7-07e868d17cc7 tempest-ProjectReaderTests33-985123374 None] Create backup finished. backup: 6bdd7c04-1a0f-4b84-b920-56964580de6c. Jul 03 02:36:11.380491 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Create backup started, backup: a717bd66-e955-4488-81c8-f9ff8d73394d volume: 1d548991-987d-4247-b25e-41f00ea6d3b3. Jul 03 02:36:11.386125 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:36:11Z,data_timestamp=2026-07-03T02:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-722166290',encryption_key_id=None,fail_reason=None,host='np0000004352',id=a717bd66-e955-4488-81c8-f9ff8d73394d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0bd417b090dd4956b0338a9a85d40867',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1c087ae6e097461883273610d71adcd5',volume_id=1d548991-987d-4247-b25e-41f00ea6d3b3) Jul 03 02:36:11.412143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:36:11.412344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:36:11.412776 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:11.422973 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:36:11.445688 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:11.459437 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:36:11.459734 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:36:11.468546 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:36:11.469857 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:a7ce', 'fe80::9c66:7aff:fe95:2dc8', 'fe80::fc16:3eff:fe55:e40d', 'fe80::b4c0:47ff:fe4b:fdac', 'fe80::fc16:3eff:fed0:97b9', 'fe80::4c23:89ff:fe57:9398', 'fe80::fc16:3eff:fe07:98bd', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:36:11.470030 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:36:11.470187 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:36:11.470481 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:11.974724 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:36:11.975214 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d548991-987d-4247-b25e-41f00ea6d3b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:11.975407 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:11.975991 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:11.976375 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d548991-987d-4247-b25e-41f00ea6d3b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:36:11.988219 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:11.988887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:11.989189 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:36:12.002979 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:36:12.002979 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3] added Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:36:12.014760 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:12.015095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:36:12.015628 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:36:12.015778 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:36:13.016690 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:36:13.027363 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:13.039887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:13.052210 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.052210 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.052210 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.052210 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.052210 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:13.052457 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.052457 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.052457 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.052457 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.052457 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:13.082115 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3, portal: 192.168.40.100,3260] Jul 03 02:36:13.082115 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3, portal: 192.168.40.100,3260] successful. Jul 03 02:36:13.082115 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:13.093022 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 (non-flash) Jul 03 02:36:13.109845 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-999d067d-b90f-453e-829a-32a96166c071 (non-flash) Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 (non-flash) Jul 03 02:36:13.110141 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:13.110555 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:13.110747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:36:13.111500 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] HCTL ('11', '-', '-', 0) found on session 157 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:36:13.111683 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Scanning host 11 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:36:13.125412 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Searching for a device in session 157 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:36:13.125600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d548991-987d-4247-b25e-41f00ea6d3b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:36:14.128836 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.153s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:14.129193 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] <== connect_volume: return (2153ms) {'type': 'block', 'scsi_wwn': '33000000028556dd3', 'path': '/dev/sdf'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:14.129375 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:14.146090 np0000004352 sudo[148175]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf Jul 03 02:36:14.146754 np0000004352 sudo[148175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:36:14.528897 np0000004352 sudo[148175]: pam_unix(sudo:session): session closed for user root Jul 03 02:36:14.533259 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdf" returned: 0 in 0.403s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:36:14.578755 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:36:14.593716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _create_container started, container: volumebackups,backup: a717bd66-e955-4488-81c8-f9ff8d73394d. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:36:14.637462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] generate_object_name_prefix: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:36:14.645674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] starting backup of volume: 1d548991-987d-4247-b25e-41f00ea6d3b3, volume size: 1073741824, object names prefix volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:36:14.867126 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:15.131395 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:15.131951 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:15.246437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:15.246640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:15.507878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:15.792023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:15.792177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:15.896607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:15.896792 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:16.101737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:16.349113 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:16.349606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:16.453415 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:16.453656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:16.665836 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:16.905378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:16.905592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:17.013827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:17.013974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:17.217150 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:17.465225 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:17.465712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:17.573933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:17.574177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:17.765355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:18.021152 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:18.021286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:18.136041 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:18.136386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:18.345975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:18.601597 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:18.602293 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:18.720147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:18.720147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:18.918270 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:19.185637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:19.186763 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:19.299749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:19.299900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:19.493588 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:19.736627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:19.737039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:19.839683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:19.839938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:20.050619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:20.321443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:20.321617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:20.438135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:20.438336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:20.688246 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:20.946183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:20.946666 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:21.050229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:21.050353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:21.221888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:21.495682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:21.495839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:21.613406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:21.613651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:21.799209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:22.052020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:22.052469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:22.152851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:22.153032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:22.363679 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:22.625400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:22.625832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:22.741554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:22.741881 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:22.927891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:23.188844 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:23.189236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:23.310442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:23.310724 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:23.508292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:23.768567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:23.768700 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:23.884447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:23.884447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:24.097292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:24.382828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:24.383438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:24.491219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:24.491514 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:24.705815 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:24.977226 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:24.977397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:25.105200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:25.105396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:25.319975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:25.585037 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:25.585505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:25.712774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:25.712978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:25.927536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:26.174139 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:26.174272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:26.287274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:26.287459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:26.383051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:26.501931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:26.502092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:26.572163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:26.572299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:26.579810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:36:26.591849 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:36:26.592245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:36:26.598989 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:36:26.601435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:36:26.602897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:36:26.603214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:36:26.675269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:36:26.679098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:36:26.711489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "a717bd66-e955-4488-81c8-f9ff8d73394d",\n "backup_name": "tempest-type-Backup-722166290",\n "created_at": "2026-07-03 02:36:11+00:00",\n "objects": [\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1d548991-987d-4247-b25e-41f00ea6d3b3",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1d548991-987d-4247-b25e-41f00ea6d3b3\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"1c087ae6e097461883273610d71adcd5\\", \\"project_id\\": \\"0bd417b090dd4956b0338a9a85d40867\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:36:10.000000\\", \\"launched_at\\": \\"2026-07-03T02:36:10.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1393477126\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:36:10.000000\\", \\"updated_at\\": \\"2026-07-03T02:36:11.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:36:26.717613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] backup a717bd66-e955-4488-81c8-f9ff8d73394d finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:36:26.837186 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:26.852467 np0000004352 sudo[148677]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf Jul 03 02:36:26.853059 np0000004352 sudo[148677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:36:27.191132 np0000004352 sudo[148677]: pam_unix(sudo:session): session closed for user root Jul 03 02:36:27.193231 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdf" returned: 0 in 0.356s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:36:27.193893 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d548991-987d-4247-b25e-41f00ea6d3b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000028556dd3', 'path': '/dev/sdf'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:27.194098 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:27.194617 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:27.194989 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1d548991-987d-4247-b25e-41f00ea6d3b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:27.211783 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:27.212151 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:36:27.212151 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:36:27.212151 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:36:27.212360 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:36:27.237092 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:27.237092 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:27.237092 np0000004352 cinder-backup[101397]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 (non-flash) Jul 03 02:36:27.237092 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:27.237384 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:27.237384 np0000004352 cinder-backup[101397]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659 (non-flash) Jul 03 02:36:27.237384 np0000004352 cinder-backup[101397]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3 (non-flash) Jul 03 02:36:27.237384 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:27.237737 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ddb51033-b508-45f7-a948-0dc069766659', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', '157')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:36:27.237737 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3', '157')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:36:27.238829 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Resulting device map defaultdict(. at 0x783584d289a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3'): ({'sdf'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:36:27.239120 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Removing single pathed devices sdf {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:36:27.252659 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Flushing IO for device /dev/sdf {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:36:27.261396 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:36:27.319542 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Checking to see if SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:36:27.319771 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] SCSI volumes sdf have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:36:27.320807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Checking to see if device paths {'sdf'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:36:27.333742 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Device paths {'sdf'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:36:27.334034 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:36:27.346467 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:27.386765 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3, portal: 192.168.40.100,3260] Jul 03 02:36:27.386765 np0000004352 cinder-backup[101397]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-1d548991-987d-4247-b25e-41f00ea6d3b3, portal: 192.168.40.100,3260] successful. Jul 03 02:36:27.386765 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:27.398477 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:27.398747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.204s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:27.398899 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] <== disconnect_volume: return (205ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:28.407392 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=187,cinder:UPDATE=48,cinder:INSERT=24 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:36:28.424950 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9093966e-9b01-4654-afa9-af54a7a106c1 tempest-ProjectReaderTests33-985123374 None] Create backup finished. backup: a717bd66-e955-4488-81c8-f9ff8d73394d. Jul 03 02:36:28.800749 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-04295fb9-2de1-4d09-8899-b9d63f8064e2 tempest-ProjectReaderTests33-985123374 None] Export record started, backup: a717bd66-e955-4488-81c8-f9ff8d73394d. Jul 03 02:36:28.805027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-04295fb9-2de1-4d09-8899-b9d63f8064e2 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:36:28.805164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-04295fb9-2de1-4d09-8899-b9d63f8064e2 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:36:28.805508 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-04295fb9-2de1-4d09-8899-b9d63f8064e2 tempest-ProjectReaderTests33-985123374 None] Export record finished, backup a717bd66-e955-4488-81c8-f9ff8d73394d exported. Jul 03 02:36:31.940876 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:36:31.948411 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Create backup started, backup: 056d312e-08d4-4a16-ac25-1ab8399b5cc9 volume: 1b299cef-ff02-439a-bfe9-a6b53486c584. Jul 03 02:36:31.961192 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:36:31Z,data_timestamp=2026-07-03T02:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-797581972',encryption_key_id=None,fail_reason=None,host='np0000004352',id=056d312e-08d4-4a16-ac25-1ab8399b5cc9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0bd417b090dd4956b0338a9a85d40867',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1c087ae6e097461883273610d71adcd5',volume_id=1b299cef-ff02-439a-bfe9-a6b53486c584) Jul 03 02:36:31.992373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:36:31.992622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:36:31.993008 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:32.003495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:36:32.025057 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:32.037097 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:36:32.037400 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:36:32.046142 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:36:32.047173 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fed0:97b9', 'fe80::4c23:89ff:fe57:9398'] Jul 03 02:36:32.047296 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:36:32.047408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:36:32.047653 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:32.551694 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:36:32.552374 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b299cef-ff02-439a-bfe9-a6b53486c584', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:32.552688 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:35.320651 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.766s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:35.320651 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b299cef-ff02-439a-bfe9-a6b53486c584', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:36:35.336728 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:35.336728 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:35.336728 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:36:35.346610 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:36:35.346610 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584] added Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:36:35.359170 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:35.359466 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:36:35.359809 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:36:35.360031 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:36:36.361392 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:36:36.373995 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:36.385608 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:36.396798 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.396798 np0000004352 cinder-backup[101397]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.396798 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:36.396956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.396956 np0000004352 cinder-backup[101397]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.396956 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:36.426921 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584, portal: 192.168.40.100,3260] Jul 03 02:36:36.426921 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584, portal: 192.168.40.100,3260] successful. Jul 03 02:36:36.426921 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:36.437722 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:36:36.450568 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.450568 np0000004352 cinder-backup[101397]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.450568 np0000004352 cinder-backup[101397]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 (non-flash) Jul 03 02:36:36.450568 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:36.450820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.450820 np0000004352 cinder-backup[101397]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:36.450820 np0000004352 cinder-backup[101397]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 (non-flash) Jul 03 02:36:36.450820 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:36.451210 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:36.451388 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:36:36.452097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] HCTL ('9', '-', '-', 0) found on session 162 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:36:36.452264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:36:36.466899 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Searching for a device in session 162 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:36:36.467988 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b299cef-ff02-439a-bfe9-a6b53486c584', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:36:37.350260 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] Delete backup started, backup: 8b76accb-7d09-41e6-aee6-18da67c2b745. Jul 03 02:36:37.354990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_367f50a8868f4d07bf688b94c9cd7544 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:36:37.355907 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:36:37.355907 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] delete started, backup: 8b76accb-7d09-41e6-aee6-18da67c2b745, container: volumebackups, prefix: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:36:37.437960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] generated object list: ['volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata', 'volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:36:37.460797 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.469699 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.151s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:36:37.469886 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] <== connect_volume: return (4916ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799138', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:36:37.470247 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:37.490702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.493306 np0000004352 sudo[149248]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:36:37.494159 np0000004352 sudo[149248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:36:37.520371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.550779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.579828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.605306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.644162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.672815 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.699832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.720564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.745875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.769600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.797062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.829507 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.863982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.888359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.918984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:37.932777 np0000004352 sudo[149248]: pam_unix(sudo:session): session closed for user root Jul 03 02:36:37.934995 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.465s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:36:37.987937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.004768 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:36:38.017333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _create_container started, container: volumebackups,backup: 056d312e-08d4-4a16-ac25-1ab8399b5cc9. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:36:38.019787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.062772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.078649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] generate_object_name_prefix: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:36:38.086231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] starting backup of volume: 1b299cef-ff02-439a-bfe9-a6b53486c584, volume size: 1073741824, object names prefix volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:36:38.113774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.168925 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.222626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] deleted object: volume_6b4ea115-40ee-4d4f-b074-6d29d4536ad6/20260703023455/az_nova_backup_8b76accb-7d09-41e6-aee6-18da67c2b745_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:36:38.223242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] delete 8b76accb-7d09-41e6-aee6-18da67c2b745 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:36:38.245777 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] Created reservations ['23607141-f67b-4679-9d95-f287ac508d04', '744d12ff-2d2d-4500-a306-cd010d09031f'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:36:38.271138 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-03666b41-7cba-4718-b9ea-295953849548 tempest-TestVolumeBackupRestore-1703538957 None] Delete backup finished, backup 8b76accb-7d09-41e6-aee6-18da67c2b745 deleted. Jul 03 02:36:38.389780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:38.652781 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:38.653323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:38.769596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:38.769724 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:39.036051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:39.328833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:39.328833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:39.466787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:39.467047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:39.801058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:40.120047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:40.120047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:40.254670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:40.254799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:40.512106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:40.781798 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:40.781798 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:40.901261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:40.901261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:41.191394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:41.465999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:41.466182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:41.587845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:41.587963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:41.869652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:42.160267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:42.160267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:42.292366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:42.292366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:42.505051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:42.766334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:42.766462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:42.885444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:42.885668 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:43.119238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:43.390692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:43.391232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:43.548740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:43.548740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:43.850567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:44.118300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:44.118562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:44.239609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:44.239609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:44.500505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:44.752436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:44.752577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:44.863366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:44.863366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:45.139190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:45.392386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:45.392664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:45.510098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:45.510511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:45.768837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:46.052725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:46.052942 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:46.193637 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:46.193776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:46.493592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:46.749702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:46.750146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:46.862962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:46.862962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:47.064474 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:47.324977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:47.325171 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:47.447977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:47.448158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:47.656955 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:47.930531 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:47.930911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:48.041718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:48.041979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:48.281281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:48.550210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:48.550463 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:48.670409 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:48.670614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:48.874381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:49.122525 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:49.122916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:49.251720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:49.251953 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:49.496384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:49.746900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:49.747172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:49.851255 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:49.851527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:50.066865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:50.356810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:50.357971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:50.479984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:50.480155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:50.765461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:51.054879 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:51.055047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:51.155411 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:51.155565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:51.262076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:36:51.385954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:36:51.386302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:36:51.449062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup MD5 for volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:36:51.449263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:36:51.455861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:36:51.460910 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:36:51.461055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:36:51.464629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:36:51.464791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:36:51.467624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:36:51.467846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:36:51.537459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:36:51.538036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _write_metadata started, container name: volumebackups, metadata filename: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:36:51.570024 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "056d312e-08d4-4a16-ac25-1ab8399b5cc9",\n "backup_name": "tempest-type-Backup-797581972",\n "created_at": "2026-07-03 02:36:32+00:00",\n "objects": [\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "1b299cef-ff02-439a-bfe9-a6b53486c584",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"1b299cef-ff02-439a-bfe9-a6b53486c584\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"1c087ae6e097461883273610d71adcd5\\", \\"project_id\\": \\"0bd417b090dd4956b0338a9a85d40867\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:36:31.000000\\", \\"launched_at\\": \\"2026-07-03T02:36:31.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1613090481\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:36:31.000000\\", \\"updated_at\\": \\"2026-07-03T02:36:32.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:36:51.581989 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] backup 056d312e-08d4-4a16-ac25-1ab8399b5cc9 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:36:51.717273 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:36:51.739025 np0000004352 sudo[150032]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:36:51.741003 np0000004352 sudo[150032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:36:52.075208 np0000004352 sudo[150032]: pam_unix(sudo:session): session closed for user root Jul 03 02:36:52.077527 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.360s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:36:52.078122 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b299cef-ff02-439a-bfe9-a6b53486c584', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799138', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:36:52.078327 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:36:59.955547 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 7.877s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:36:59.955982 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b299cef-ff02-439a-bfe9-a6b53486c584', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:36:59.966409 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:59.967064 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:36:59.967064 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:36:59.967064 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:36:59.967064 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799 (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799 (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb (non-flash) Jul 03 02:36:59.990895 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584 (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2 (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799 (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799 (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb (non-flash) Jul 03 02:36:59.991308 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:36:59.991735 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2522d5d1-4dff-49f8-b4b3-2fa88e55de8d', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9db1a9c5-5bb2-4931-81b3-3beeb8f956b2', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6bb12ee-02c1-44dc-95a7-be94f9414799', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c90aa8e-9e6c-4f92-86d0-3e504d0408eb', '172')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:36:59.991942 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584', '162')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:36:59.993177 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Resulting device map defaultdict(. at 0x78357a8c1760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:36:59.993682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:37:00.002947 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:37:00.009349 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:37:00.052854 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:37:00.053015 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:37:00.054132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:37:00.064992 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:37:00.065158 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:37:00.075960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:37:00.114555 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584, portal: 192.168.40.100,3260] Jul 03 02:37:00.114555 np0000004352 cinder-backup[101397]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-1b299cef-ff02-439a-bfe9-a6b53486c584, portal: 192.168.40.100,3260] successful. Jul 03 02:37:00.114555 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:37:00.131911 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:37:00.132109 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.177s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:37:00.132297 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] <== disconnect_volume: return (8053ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:37:01.151156 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-f5f22d49-3c22-40aa-9fb2-2f52946fdf08 tempest-ProjectReaderTests33-985123374 None] Create backup finished. backup: 056d312e-08d4-4a16-ac25-1ab8399b5cc9. Jul 03 02:37:02.793545 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] Delete backup started, backup: 056d312e-08d4-4a16-ac25-1ab8399b5cc9. Jul 03 02:37:02.800923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:37:02.801337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:37:02.801608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] delete started, backup: 056d312e-08d4-4a16-ac25-1ab8399b5cc9, container: volumebackups, prefix: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:37:02.853736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] generated object list: ['volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00001', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00002', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00003', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00004', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00005', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00006', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00007', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00008', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00009', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00010', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00011', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00012', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00013', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00014', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00015', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00016', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00017', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00018', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00019', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00020', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00021', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_metadata', 'volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:37:02.881954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:02.901865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:02.925578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:02.951979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:02.983966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.004836 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.027990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.048198 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.056442 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:37:03.056628 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:37:03.076464 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.103189 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.125822 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.144072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.164766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.194445 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.215974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.237017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.254808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.273088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.293811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.312870 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.332733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.354646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.379600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1b299cef-ff02-439a-bfe9-a6b53486c584/20260703023638/az_nova_backup_056d312e-08d4-4a16-ac25-1ab8399b5cc9_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.379843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] delete 056d312e-08d4-4a16-ac25-1ab8399b5cc9 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:37:03.422677 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:37:03.441600 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] Created reservations ['4d159e26-8bcf-4deb-8143-5b7ab2af5598', '2b6e6177-ae30-465e-97e3-9f3fecb614cf'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:37:03.461435 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3faab685-4531-40d6-83d8-5015807388e0 tempest-ProjectReaderTests33-985123374 None] Delete backup finished, backup 056d312e-08d4-4a16-ac25-1ab8399b5cc9 deleted. Jul 03 02:37:03.858519 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] Delete backup started, backup: a717bd66-e955-4488-81c8-f9ff8d73394d. Jul 03 02:37:03.861399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:37:03.861617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:37:03.861792 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] delete started, backup: a717bd66-e955-4488-81c8-f9ff8d73394d, container: volumebackups, prefix: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:37:03.901905 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] generated object list: ['volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00001', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00002', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00003', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00004', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00005', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00006', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00007', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00008', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00009', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00010', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00011', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00012', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00013', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00014', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00015', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00016', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00017', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00018', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00019', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00020', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00021', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_metadata', 'volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:37:03.919730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.945641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.967175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:03.989984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.011364 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.034063 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.065527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.086398 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.114870 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.138465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.161694 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.186558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.208503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.234200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.265819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.292604 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.313900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.335104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.357272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.378496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.401878 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.425221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.447787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] deleted object: volume_1d548991-987d-4247-b25e-41f00ea6d3b3/20260703023614/az_nova_backup_a717bd66-e955-4488-81c8-f9ff8d73394d_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:04.448031 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] delete a717bd66-e955-4488-81c8-f9ff8d73394d finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:37:04.482776 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:37:04.499334 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] Created reservations ['5ec5c25a-abbe-43c8-995c-820a2021a9d1', '09b0fe66-c702-485b-81ee-73eaa299be28'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:37:04.519757 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-c69b18ca-c090-4edd-a06d-dcb3cb7550e8 tempest-ProjectReaderTests33-985123374 None] Delete backup finished, backup a717bd66-e955-4488-81c8-f9ff8d73394d deleted. Jul 03 02:37:04.947410 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] Delete backup started, backup: 6bdd7c04-1a0f-4b84-b920-56964580de6c. Jul 03 02:37:04.951234 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_0bd417b090dd4956b0338a9a85d40867 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:37:04.951538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:37:04.951538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] delete started, backup: 6bdd7c04-1a0f-4b84-b920-56964580de6c, container: volumebackups, prefix: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:37:05.012204 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] generated object list: ['volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00001', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00002', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00003', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00004', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00005', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00006', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00007', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00008', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00009', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00010', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00011', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00012', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00013', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00014', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00015', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00016', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00017', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00018', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00019', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00020', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00021', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_metadata', 'volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:37:05.034560 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.060012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.088122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.116353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.139966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.169055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.204785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.234541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.261040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.287754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.323886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.352837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.390038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.423365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.448911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.491061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.515730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.544430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.567776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.596746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.625408 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.648864 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.669739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] deleted object: volume_5b14a554-ae2d-43d5-b402-740f38d2b791/20260703023552/az_nova_backup_6bdd7c04-1a0f-4b84-b920-56964580de6c_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:37:05.669959 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] delete 6bdd7c04-1a0f-4b84-b920-56964580de6c finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:37:05.702861 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:37:05.715861 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] Created reservations ['a4154264-ec99-4657-bcbf-e73af44554ca', '21800b3d-6245-49d0-9277-0402c9fdc59f'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:37:05.733940 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-6291a3c4-f0a8-4a12-a491-8d1a0075c05e tempest-ProjectReaderTests33-985123374 None] Delete backup finished, backup 6bdd7c04-1a0f-4b84-b920-56964580de6c deleted. Jul 03 02:37:15.726959 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:UPDATE=33,cinder:SELECT=60,cinder:INSERT=8 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:37:59.896322 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Create backup started, backup: 37d5523e-fb4e-4303-b716-fc6e904976e1 volume: 12be2b98-4c51-43c5-817a-0c0e39aa1dcf. Jul 03 02:37:59.906006 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:37:59Z,data_timestamp=2026-07-03T02:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-312805689',encryption_key_id=None,fail_reason=None,host='np0000004352',id=37d5523e-fb4e-4303-b716-fc6e904976e1,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1ed6c153b2ca44cf95e04650aabfde9a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6c9ee0ec801d4d27b460644fb71313d7',volume_id=12be2b98-4c51-43c5-817a-0c0e39aa1dcf) Jul 03 02:37:59.954954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:37:59.955311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:37:59.955871 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:37:59.969266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:37:59.993224 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:00.009327 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:38:00.009327 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:38:00.018800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:38:00.019972 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:febb:c6f2', 'fe80::64ab:fff:fe8d:8509', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da'] Jul 03 02:38:00.020153 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:38:00.020209 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:38:00.020557 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (64ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:00.525657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:38:00.526135 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:00.526644 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:00.527053 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:00.527341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:38:00.540384 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:00.541323 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:00.541787 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:00.568310 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:38:00.568310 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf] added Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:00.580181 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:00.580618 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:38:00.580950 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:38:00.581845 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:38:01.582359 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:38:01.592948 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:01.605518 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.625916 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:01.663630 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] Jul 03 02:38:01.663630 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] successful. Jul 03 02:38:01.663630 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:01.674616 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:01.688263 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:01.688575 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:01.688806 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:01.688960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:38:01.689805 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] HCTL ('13', '-', '-', 0) found on session 183 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:38:01.689948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:38:01.704116 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 183 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:01.704116 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:38:02.707891 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:02.708518 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (2181ms) {'type': 'block', 'scsi_wwn': '330000000fb8a2edd', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:02.708518 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:02.730196 np0000004352 sudo[152545]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:38:02.730827 np0000004352 sudo[152545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:03.061365 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:38:03.061594 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:38:03.069593 np0000004352 sudo[152545]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:03.073605 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.363s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:03.138806 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:03.148405 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _create_container started, container: volumebackups,backup: 37d5523e-fb4e-4303-b716-fc6e904976e1. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:38:03.379564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] generate_object_name_prefix: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:38:03.386844 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] starting backup of volume: 12be2b98-4c51-43c5-817a-0c0e39aa1dcf, volume size: 1073741824, object names prefix volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:38:03.576561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:03.844328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:03.844738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:03.964963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:03.965101 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:04.167892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:04.437357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:04.437541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:04.547882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:04.548145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:04.765965 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:05.046203 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:05.046620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:05.178155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:05.178378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:05.409656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:05.672601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:05.673080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:05.791535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:05.791535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:05.992365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:06.286437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:06.286437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:06.391022 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:06.391022 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:06.584294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:06.833468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:06.833468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:06.954183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:06.954183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:07.133064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:07.395964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:07.399976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:07.515023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:07.515023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:07.763182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:08.018670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:08.018670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:08.136572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:08.136572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:08.325522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:08.564151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:08.564151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:08.667591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:08.667591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:08.841629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:09.087958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:09.087958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:09.205707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:09.205707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:09.445811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:09.708530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:09.708970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:09.813274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:09.813484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:10.003313 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:10.280401 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:10.280401 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:10.391991 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:10.392194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:10.585556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:10.863220 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:10.863707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:10.975166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:10.975336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:11.187443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:11.437477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:11.437647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:11.537831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:11.538168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:11.768601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:12.057559 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:12.057916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:12.168239 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:12.168372 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:12.409943 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:12.707918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:12.708192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:12.830303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:12.830598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:13.062589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:13.335309 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:13.335542 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:13.442162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:13.442342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:13.644012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:13.889620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:13.889882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:14.016366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:14.016550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:14.234356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:14.516844 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:14.517181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:14.629520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:14.629742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:14.818693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:15.064201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:15.064349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:15.171718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:15.171718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:15.278657 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:15.407057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:15.407210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:15.469212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:15.469364 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:15.474916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:38:15.479796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:38:15.479923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:38:15.483077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:38:15.483199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:38:15.485801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:38:15.486008 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:38:15.540831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:38:15.541325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _write_metadata started, container name: volumebackups, metadata filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:38:15.567075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "37d5523e-fb4e-4303-b716-fc6e904976e1",\n "backup_name": "tempest-type-Backup-312805689",\n "created_at": "2026-07-03 02:38:00+00:00",\n "objects": [\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "12be2b98-4c51-43c5-817a-0c0e39aa1dcf",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"12be2b98-4c51-43c5-817a-0c0e39aa1dcf\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6c9ee0ec801d4d27b460644fb71313d7\\", \\"project_id\\": \\"1ed6c153b2ca44cf95e04650aabfde9a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:37:59.000000\\", \\"launched_at\\": \\"2026-07-03T02:37:59.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1375138082\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:37:59.000000\\", \\"updated_at\\": \\"2026-07-03T02:38:00.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:38:15.577656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] backup 37d5523e-fb4e-4303-b716-fc6e904976e1 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:38:15.701370 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:15.716305 np0000004352 sudo[153099]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:38:15.717047 np0000004352 sudo[153099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:16.026053 np0000004352 sudo[153099]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:16.028659 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.327s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:16.029445 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000fb8a2edd', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:16.029709 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:17.692317 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.662s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:17.692835 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:17.707615 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:17.708600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:38:17.708600 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:38:17.708600 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:38:17.708600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:17.734783 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '187')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:38:17.735458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', '183')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:38:17.736852 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a540fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:38:17.737134 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:38:17.748411 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:38:17.756595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:38:17.803939 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:38:17.804151 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:38:17.805863 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:38:17.817339 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:38:17.817685 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:38:17.828192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:17.862925 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] Jul 03 02:38:17.862925 np0000004352 cinder-backup[101397]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] successful. Jul 03 02:38:17.862925 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:17.880682 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:17.880952 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.189s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:17.881100 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (1851ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:18.905825 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-9233280a-2dd5-41f5-94b9-94b1cd96d8b7 tempest-ProjectMemberTests33-787641266 None] Create backup finished. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1. Jul 03 02:38:19.521749 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Create backup started, backup: 1203eb58-e7a1-47fa-b38f-ee0aa4601e30 volume: 12be2b98-4c51-43c5-817a-0c0e39aa1dcf. Jul 03 02:38:19.526874 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:38:19Z,data_timestamp=2026-07-03T02:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='np0000004352',id=1203eb58-e7a1-47fa-b38f-ee0aa4601e30,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1ed6c153b2ca44cf95e04650aabfde9a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='186d60896b564ba8bdf206733d058587',volume_id=12be2b98-4c51-43c5-817a-0c0e39aa1dcf) Jul 03 02:38:19.549483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:19.549655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:19.549904 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:19.559521 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:38:19.578438 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:19.588939 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:38:19.589132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:38:19.597229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:38:19.598295 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:febb:c6f2', 'fe80::64ab:fff:fe8d:8509', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da'] Jul 03 02:38:19.598456 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:38:19.598599 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:38:19.598916 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:20.102920 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:38:20.103381 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:20.103381 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:22.564127 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.460s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:22.564957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:38:22.575464 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:22.575600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:22.575765 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:22.585797 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:38:22.585797 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf] added Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:22.598145 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:22.598499 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:38:22.598785 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:38:22.599039 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:38:23.600578 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:38:23.610993 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:23.625894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.643538 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.643812 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:23.703605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] Jul 03 02:38:23.703605 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] successful. Jul 03 02:38:23.703605 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:23.713759 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:23.714289 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:23.720619 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Create backup started, backup: 33827318-6d0f-4e40-a70b-ae56c3649e22 volume: 0afce53f-c70b-4d81-af26-b161b515ffc1. Jul 03 02:38:23.725772 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container='tempest-volumesbackupsv39test-backup-container-203756448',created_at=2026-07-03T02:38:23Z,data_timestamp=2026-07-03T02:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-718975164',encryption_key_id=None,fail_reason=None,host='np0000004352',id=33827318-6d0f-4e40-a70b-ae56c3649e22,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='33d9ca9a46924bd1bd0ca9cff45cde9f',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c9e02a7900944112ab9e797e62c5957e',volume_id=0afce53f-c70b-4d81-af26-b161b515ffc1) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:23.730612 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:23.730936 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:23.731207 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:23.731304 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:38:23.732193 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] HCTL ('13', '-', '-', 0) found on session 190 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:38:23.732346 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:38:23.745188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 190 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:23.745188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:38:23.753322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_33d9ca9a46924bd1bd0ca9cff45cde9f {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:23.753529 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:23.753821 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:23.763246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:38:23.784828 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:23.800139 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:38:23.800455 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:38:23.808672 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:38:23.809834 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:feb4:f76f', 'fe80::4a4:ffff:fe12:1758'] Jul 03 02:38:23.810001 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:38:23.810137 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:38:23.810376 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:24.315599 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:38:24.316107 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afce53f-c70b-4d81-af26-b161b515ffc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:24.316302 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:24.747936 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.184s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:24.748471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (4644ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799186', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:24.748697 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:24.754899 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.438s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:24.755352 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afce53f-c70b-4d81-af26-b161b515ffc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:38:24.768330 np0000004352 sudo[153620]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:38:24.769192 np0000004352 sudo[153620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:24.770086 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:24.770630 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:24.770898 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:24.782989 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:38:24.782989 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1] added Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:24.792885 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:24.793110 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:38:24.793607 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:38:24.793820 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:38:25.067536 np0000004352 sudo[153620]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:25.069111 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.320s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:25.112960 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:25.118473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _create_container started, container: volumebackups,backup: 1203eb58-e7a1-47fa-b38f-ee0aa4601e30. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:38:25.295050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] generate_object_name_prefix: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:38:25.304047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] starting backup of volume: 12be2b98-4c51-43c5-817a-0c0e39aa1dcf, volume size: 1073741824, object names prefix volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:38:25.495018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:25.778899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:25.779320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:25.794804 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:38:25.809843 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:25.822207 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:25.841595 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:25.841950 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:25.884068 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1, portal: 192.168.40.100,3260] Jul 03 02:38:25.884068 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1, portal: 192.168.40.100,3260] successful. Jul 03 02:38:25.884068 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:25.887052 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:25.887133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:25.895770 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:25.918290 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:25.919118 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:38:25.920102 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] HCTL ('16', '-', '-', 0) found on session 191 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:38:25.920231 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Scanning host 16 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:38:25.940378 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Searching for a device in session 191 and hctl ['16', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:26.106886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:26.359779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:26.359868 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:26.473602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:26.473746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:26.678901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:26.921388 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:26.921852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:26.941658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Searching for a device in session 191 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:26.941876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afce53f-c70b-4d81-af26-b161b515ffc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:38:26.942571 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.189s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:26.942763 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] <== connect_volume: return (2626ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799194', 'path': '/dev/sdk'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:26.943106 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:26.962656 np0000004352 sudo[153724]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk Jul 03 02:38:26.963280 np0000004352 sudo[153724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:27.039658 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:27.039985 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:27.304381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:27.326473 np0000004352 sudo[153724]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:27.328763 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdk" returned: 0 in 0.385s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:27.336584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _create_container started, container: tempest-volumesbackupsv39test-backup-container-203756448,backup: 33827318-6d0f-4e40-a70b-ae56c3649e22. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:38:27.447493 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] generate_object_name_prefix: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:38:27.457215 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] starting backup of volume: 0afce53f-c70b-4d81-af26-b161b515ffc1, volume size: 1073741824, object names prefix volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:38:27.575367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:27.576560 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:27.637616 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:27.688145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:27.688336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:27.889148 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:27.889407 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:27.928091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:28.002835 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:28.003034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:28.178100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:28.178218 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:28.220784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:28.302593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:28.302721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:28.477481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:28.478888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:28.536471 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:28.607326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:28.607462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:28.796557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:28.877966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:28.878095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:28.990449 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:28.990971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:29.050442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:29.052938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:29.183227 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:29.183465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:29.194432 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:29.383987 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:29.452071 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:29.452297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:29.563803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:29.564031 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:29.637931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:29.639502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:29.769181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:29.769546 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:29.823644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:30.028672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:30.172815 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:30.173033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:30.289791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:30.290035 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:30.296847 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:30.298233 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:30.423675 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:30.424730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:30.545591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:30.689496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:30.802903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:30.803091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:30.918138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:30.918264 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:30.940551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:30.940551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:31.062230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:31.062799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:31.166633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:31.306211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:31.436235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:31.436433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:31.554956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:31.555137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:31.600281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:31.600281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:31.726444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:31.726594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:31.808541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:31.975241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:32.078712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:32.079158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:32.196061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:32.196216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:32.277822 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:32.277899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:32.385784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:32.386014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:32.416692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:32.588859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:32.693025 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:32.693190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:32.797509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:32.797747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:32.874821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:32.875217 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:33.014172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:33.014311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:33.033583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:33.221734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:33.393913 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:33.394054 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:33.492247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:33.492389 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:33.510323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:33.510549 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:33.599607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:33.599817 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:33.790517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:33.859784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:34.054981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:34.054981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:34.120183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:34.120304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:34.175983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:34.176248 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:34.228359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:34.228837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:34.437344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:34.486175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:34.730181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:34.730290 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:34.757317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:34.757547 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:34.836259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:34.836470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:34.863684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:34.863739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:35.156737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:35.168217 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:35.409845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:35.410303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:35.425245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:35.425433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:35.521116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:35.521312 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:35.547895 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:35.548039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:35.828656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:35.837510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:36.076620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:36.076620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:36.130036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:36.130212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:36.179066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:36.179200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:36.228333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:36.228577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:36.431249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:36.484161 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:36.675867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:36.676014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:36.728267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:36.728528 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:36.778140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:36.778258 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:36.834753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:36.834912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:37.025293 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:37.079007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:37.290703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:37.290812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:37.437625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:37.438037 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:37.535984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:37.536182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:37.541348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:37.541463 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:37.854026 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:37.855515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:38.113029 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:38.113169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:38.116744 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:38.116873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:38.227034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:38.227173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:38.240208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:38.240659 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:38.401060 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:38.487648 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:38.519674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:38.519874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:38.584532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:38.584740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:38.591736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:38:38.597362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:38:38.597537 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:38:38.601889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:38:38.602072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:38:38.605368 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:38:38.605632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:38:38.666108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:38:38.666681 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _write_metadata started, container name: volumebackups, metadata filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:38:38.688130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1203eb58-e7a1-47fa-b38f-ee0aa4601e30",\n "backup_name": null,\n "created_at": "2026-07-03 02:38:19+00:00",\n "objects": [\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "12be2b98-4c51-43c5-817a-0c0e39aa1dcf",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"12be2b98-4c51-43c5-817a-0c0e39aa1dcf\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6c9ee0ec801d4d27b460644fb71313d7\\", \\"project_id\\": \\"1ed6c153b2ca44cf95e04650aabfde9a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:37:59.000000\\", \\"launched_at\\": \\"2026-07-03T02:37:59.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1375138082\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:37:59.000000\\", \\"updated_at\\": \\"2026-07-03T02:38:19.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:38:38.693088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] backup 1203eb58-e7a1-47fa-b38f-ee0aa4601e30 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:38:38.820699 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:38.829023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:38.829247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:38.839216 np0000004352 sudo[153759]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:38:38.839825 np0000004352 sudo[153759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:38.950152 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:38.950728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:39.146090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:39.149166 np0000004352 sudo[153759]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:39.150877 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.331s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:39.151674 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799186', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:39.151981 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:39.152578 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:39.153148 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:39.166132 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:39.167246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:38:39.167246 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:38:39.167246 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:38:39.167246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:39.197240 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:39.198088 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', '191')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:38:39.198088 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf', '190')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:38:39.200569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a86bb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:38:39.200569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:38:39.211331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:38:39.219569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:38:39.272618 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:38:39.272766 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:38:39.274005 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:38:39.283873 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:38:39.284127 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:38:39.296332 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:39.333055 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] Jul 03 02:38:39.333055 np0000004352 cinder-backup[101397]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-12be2b98-4c51-43c5-817a-0c0e39aa1dcf, portal: 192.168.40.100,3260] successful. Jul 03 02:38:39.333055 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:39.350852 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:39.351471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.199s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:39.351471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (199ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:39.424455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:39.424684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:39.531732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:39.532051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:39.744117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:40.001390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:40.001583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:40.105782 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:40.105936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:40.201171 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:40.332725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:40.332827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:40.377311 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ec200a4c-1b43-402c-9b1a-64210a307615 tempest-ProjectMemberTests33-787641266 None] Create backup finished. backup: 1203eb58-e7a1-47fa-b38f-ee0aa4601e30. Jul 03 02:38:40.406434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup MD5 for volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:40.406434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:40.413176 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:38:40.419259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:38:40.419322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:38:40.423231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:38:40.423349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:38:40.428680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:38:40.428933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _write_sha256file started, container name: tempest-volumesbackupsv39test-backup-container-203756448, sha256file filename: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:38:40.492314 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:38:40.493656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _write_metadata started, container name: tempest-volumesbackupsv39test-backup-container-203756448, metadata filename: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:38:40.519391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "33827318-6d0f-4e40-a70b-ae56c3649e22",\n "backup_name": "tempest-VolumesBackupsV39Test-Backup-718975164",\n "created_at": "2026-07-03 02:38:24+00:00",\n "objects": [\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "0afce53f-c70b-4d81-af26-b161b515ffc1",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"0afce53f-c70b-4d81-af26-b161b515ffc1\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"c9e02a7900944112ab9e797e62c5957e\\", \\"project_id\\": \\"33d9ca9a46924bd1bd0ca9cff45cde9f\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:38:23.000000\\", \\"launched_at\\": \\"2026-07-03T02:38:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsV39Test-Volume-1800278145\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:38:22.000000\\", \\"updated_at\\": \\"2026-07-03T02:38:24.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:38:40.528095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] backup 33827318-6d0f-4e40-a70b-ae56c3649e22 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:38:40.652998 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:40.668630 np0000004352 sudo[153795]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk Jul 03 02:38:40.669340 np0000004352 sudo[153795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:40.985864 np0000004352 sudo[153795]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:40.987860 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdk" returned: 0 in 0.335s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:40.988546 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afce53f-c70b-4d81-af26-b161b515ffc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799194', 'path': '/dev/sdk'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:40.988776 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:40.989274 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:40.989648 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0afce53f-c70b-4d81-af26-b161b515ffc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:38:41.002395 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:41.003027 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:38:41.003027 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:38:41.003027 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:38:41.003109 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:41.028375 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: tcp: [191] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1 (non-flash) Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:41.028739 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', '191')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:38:41.028983 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1', '191')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:38:41.029825 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Resulting device map defaultdict(. at 0x78357a869b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1'): ({'sdk'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:38:41.030024 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Removing single pathed devices sdk {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:38:41.032333 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] Delete backup started, backup: 1203eb58-e7a1-47fa-b38f-ee0aa4601e30. Jul 03 02:38:41.039032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:41.039135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:41.039276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] delete started, backup: 1203eb58-e7a1-47fa-b38f-ee0aa4601e30, container: volumebackups, prefix: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:38:41.044490 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Flushing IO for device /dev/sdk {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:38:41.054996 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:38:41.099033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00001', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00002', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00003', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00004', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00005', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00006', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00007', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00008', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00009', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00010', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00011', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00012', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00013', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00014', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00015', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00016', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00017', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00018', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00019', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00020', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00021', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_metadata', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:38:41.101609 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Checking to see if SCSI volumes sdk have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:38:41.101800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] SCSI volumes sdk have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:38:41.102872 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Checking to see if device paths {'sdk'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:38:41.117606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Device paths {'sdk'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:38:41.117606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:38:41.125862 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.129723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:41.147410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.169792 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.177818 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1, portal: 192.168.40.100,3260] Jul 03 02:38:41.177818 np0000004352 cinder-backup[101397]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-0afce53f-c70b-4d81-af26-b161b515ffc1, portal: 192.168.40.100,3260] successful. Jul 03 02:38:41.177818 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:41.194231 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:41.194575 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.205s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:41.194813 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] <== disconnect_volume: return (206ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:41.201260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.238300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.265317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.289671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.310092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.332758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.353667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.372935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.397997 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.419438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.439389 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.461541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.483834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.506992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.528947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.550012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.572065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.598481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.619166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.644155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023825/az_nova_backup_1203eb58-e7a1-47fa-b38f-ee0aa4601e30_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:41.644370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] delete 1203eb58-e7a1-47fa-b38f-ee0aa4601e30 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:38:41.687025 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:41.701665 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] Created reservations ['0f858c8e-cce1-4204-9b58-1df5d2b73e83', '0154963f-7f44-4d78-8645-5c8baa489234'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:38:41.718876 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0726620d-2629-47d0-b10e-cb34252c1e7e tempest-ProjectMemberTests33-787641266 None] Delete backup finished, backup 1203eb58-e7a1-47fa-b38f-ee0aa4601e30 deleted. Jul 03 02:38:42.216614 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-666974d2-8b20-485c-866e-eb5447607f03 tempest-VolumesBackupsV39Test-1600291244 None] Create backup finished. backup: 33827318-6d0f-4e40-a70b-ae56c3649e22. Jul 03 02:38:42.391110 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Create backup started, backup: 3052116d-a983-42cd-95e3-387c6feafff4 volume: 6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3. Jul 03 02:38:42.397385 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:38:42Z,data_timestamp=2026-07-03T02:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-12036201',encryption_key_id=None,fail_reason=None,host='np0000004352',id=3052116d-a983-42cd-95e3-387c6feafff4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1ed6c153b2ca44cf95e04650aabfde9a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6c9ee0ec801d4d27b460644fb71313d7',volume_id=6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3) Jul 03 02:38:42.422485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:42.422598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:42.422864 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:42.432935 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:38:42.452260 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:42.462388 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:38:42.462704 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:38:42.471103 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:38:42.472397 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:feb4:f76f', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe47:b050'] Jul 03 02:38:42.472577 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:38:42.472714 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:38:42.473045 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (50ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:42.976820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:38:42.977232 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:42.977364 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:42.977782 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:42.977986 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:38:42.991401 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:42.991401 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:42.991754 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:43.002555 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:38:43.002555 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3] added Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:43.012346 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:43.012830 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:38:43.012952 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:38:43.013155 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:38:43.243809 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] Delete backup started, backup: 33827318-6d0f-4e40-a70b-ae56c3649e22. Jul 03 02:38:43.244937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_33d9ca9a46924bd1bd0ca9cff45cde9f {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:43.245151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:43.245373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] delete started, backup: 33827318-6d0f-4e40-a70b-ae56c3649e22, container: tempest-volumesbackupsv39test-backup-container-203756448, prefix: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:38:43.290338 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] generated object list: ['volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00001', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00002', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00003', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00004', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00005', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00006', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00007', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00008', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00009', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00010', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00011', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00012', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00013', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00014', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00015', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00016', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00017', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00018', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00019', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00020', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00021', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_metadata', 'volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:38:43.312210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00001 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.332482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00002 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.358612 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00003 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.375531 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00004 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.395517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00005 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.414994 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00006 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.433371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00007 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.455243 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00008 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.473511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00009 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.507615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00010 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.532078 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00011 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.553458 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00012 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.578897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00013 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.600844 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00014 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.621266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00015 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.641369 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00016 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.661294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00017 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.683056 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00018 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.704461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00019 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.729481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00020 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.755977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22-00021 in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.775025 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_metadata in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.793717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] deleted object: volume_0afce53f-c70b-4d81-af26-b161b515ffc1/20260703023827/az_nova_backup_33827318-6d0f-4e40-a70b-ae56c3649e22_sha256file in container: tempest-volumesbackupsv39test-backup-container-203756448. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:38:43.793987 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] delete 33827318-6d0f-4e40-a70b-ae56c3649e22 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:38:43.836021 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:43.849657 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] Created reservations ['1defaa42-2d94-48ec-a26e-43f3a4d5620e', '0cc2fa13-d227-48fb-9e62-7259a26cf162'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:38:43.863790 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-2c0cc5ef-c3b2-41f2-bb1c-51abf9ad5f1d tempest-VolumesBackupsV39Test-1600291244 None] Delete backup finished, backup 33827318-6d0f-4e40-a70b-ae56c3649e22 deleted. Jul 03 02:38:44.014515 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:38:44.025746 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:44.036228 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.051894 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.052104 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:44.098650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, portal: 192.168.40.100,3260] Jul 03 02:38:44.098650 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, portal: 192.168.40.100,3260] successful. Jul 03 02:38:44.098650 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:44.109094 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:44.125052 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:44.125316 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:44.125603 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:44.125603 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:38:44.126491 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] HCTL ('13', '-', '-', 0) found on session 192 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:38:44.126607 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:38:44.138806 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 192 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:44.138929 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:38:45.142495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.165s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:45.143011 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (2164ms) {'type': 'block', 'scsi_wwn': '3300000006ad87347', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:45.143063 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:45.158318 np0000004352 sudo[153903]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:38:45.158996 np0000004352 sudo[153903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:45.457360 np0000004352 sudo[153903]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:45.459505 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.316s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:45.469430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _create_container started, container: volumebackups,backup: 3052116d-a983-42cd-95e3-387c6feafff4. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:38:45.506706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] generate_object_name_prefix: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:38:45.514772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] starting backup of volume: 6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, volume size: 1073741824, object names prefix volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:38:45.702659 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:45.953865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:45.953999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:46.059199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:46.059343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:46.240736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:46.500240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:46.500442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:46.625944 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:46.626124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:46.819848 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:47.104391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:47.104533 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:47.206111 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:47.206279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:47.412282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:47.652254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:47.652379 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:47.799870 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:47.800089 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:48.004316 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:48.264066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:48.264209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:48.376467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:48.376467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:48.564373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:48.818236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:48.819141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:48.927158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:48.927348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:49.106143 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:49.350539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:49.350769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:49.482002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:49.482215 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:49.682568 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:49.936889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:49.937057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:50.057735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:50.057890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:50.269893 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:50.524356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:50.524600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:50.650189 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:50.650455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:50.865307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:51.113403 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:51.113614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:51.227074 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:51.227242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:51.422414 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:51.685745 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:51.685929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:51.793024 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:51.793149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:51.977683 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: 77e55999-146b-4da7-b742-ab2ff07bad68 volume: f5452404-0af7-40c2-893e-59b3d054dcc7. Jul 03 02:38:51.983879 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:38:51Z,data_timestamp=2026-07-03T02:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1276278632',encryption_key_id=None,fail_reason=None,host='np0000004352',id=77e55999-146b-4da7-b742-ab2ff07bad68,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=f5452404-0af7-40c2-893e-59b3d054dcc7) Jul 03 02:38:52.008548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:38:52.008815 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:38:52.009267 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:52.021681 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:38:52.038517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:52.042510 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:52.055501 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:38:52.055837 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:38:52.063867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:38:52.065270 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:feb4:f76f', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe47:b050'] Jul 03 02:38:52.065452 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:38:52.065600 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:38:52.065931 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (56ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:52.294551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:52.294718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:52.399520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:52.399520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:52.434013 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:38:52.580766 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:38:52.581177 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:52.581326 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:52.581881 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:52.582188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:38:52.591916 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:52.592438 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:38:52.592689 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:52.605222 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:38:52.605222 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7] added Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:38:52.615012 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:52.615354 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:38:52.615848 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:38:52.616018 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:38:52.629440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:52.875756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:52.875940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:52.978373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:52.978880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:53.204796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:53.453331 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:53.453522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:53.563366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:53.563552 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:53.617402 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:38:53.631461 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:53.645607 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.663449 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.663824 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:53.708819 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] Jul 03 02:38:53.708819 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] successful. Jul 03 02:38:53.708819 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:53.723308 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:38:53.742162 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:38:53.742547 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:38:53.742949 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:53.743082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:38:53.744728 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] HCTL ('18', '-', '-', 0) found on session 195 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:38:53.744913 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Scanning host 18 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:38:53.759082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 195 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:38:53.759082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:38:53.765003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:54.008116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:54.008116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:54.108826 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:54.108950 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:54.323704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:54.562486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:54.562605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:54.664117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:54.665861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:54.763362 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.181s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:38:54.763840 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2181ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799207', 'path': '/dev/sdm'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:38:54.763920 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:54.782967 np0000004352 sudo[154145]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm Jul 03 02:38:54.783626 np0000004352 sudo[154145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:54.860856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:55.085590 np0000004352 sudo[154145]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:55.087568 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdm" returned: 0 in 0.323s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:55.100726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: 77e55999-146b-4da7-b742-ab2ff07bad68. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:38:55.123930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:55.124166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:55.231482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:55.231619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:55.310872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:38:55.315660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: f5452404-0af7-40c2-893e-59b3d054dcc7, volume size: 1073741824, object names prefix volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:38:55.467380 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:55.559709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:55.724093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:55.724212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:55.813904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:55.814045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:55.825805 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:55.825964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:55.827384 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=133,cinder:UPDATE=35,cinder:INSERT=4 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:38:55.925516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:55.925710 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:56.059289 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:56.151997 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:56.346727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:56.347131 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:56.413729 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:56.413986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:56.471850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:56.471850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:56.529155 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:56.530347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:56.728214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:56.773826 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:56.974733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:56.974898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:57.012961 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:57.013088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:57.086112 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:57.086305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:57.122348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:57.122562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:57.230177 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:57.373075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:57.374267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:57.374496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:57.442509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:57.442644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:57.449439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:38:57.454481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:38:57.454631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:38:57.458617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:38:57.458811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:38:57.463125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:38:57.463125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:38:57.538537 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:38:57.539195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _write_metadata started, container name: volumebackups, metadata filename: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:38:57.563786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "3052116d-a983-42cd-95e3-387c6feafff4",\n "backup_name": "tempest-type-Backup-12036201",\n "created_at": "2026-07-03 02:38:42+00:00",\n "objects": [\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6c9ee0ec801d4d27b460644fb71313d7\\", \\"project_id\\": \\"1ed6c153b2ca44cf95e04650aabfde9a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:38:41.000000\\", \\"launched_at\\": \\"2026-07-03T02:38:41.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1127455419\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:38:41.000000\\", \\"updated_at\\": \\"2026-07-03T02:38:42.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:38:57.572335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] backup 3052116d-a983-42cd-95e3-387c6feafff4 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:38:57.697662 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:38:57.705141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:57.705327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:57.715952 np0000004352 sudo[154370]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:38:57.716638 np0000004352 sudo[154370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:38:57.811629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:57.811857 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:58.034942 np0000004352 sudo[154370]: pam_unix(sudo:session): session closed for user root Jul 03 02:38:58.037711 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.340s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:38:58.037839 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '3300000006ad87347', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:38:58.038691 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:38:58.044685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:58.324788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:58.325333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:58.451773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:58.451773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:58.691899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:58.953748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:58.953869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:59.063387 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:59.063632 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:59.251554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:38:59.508485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:38:59.508949 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:38:59.608631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:38:59.608900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:38:59.795811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:00.049476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:00.049674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:00.178223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:00.178223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:00.384012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:00.632293 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:00.632801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:00.742263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:00.742434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:00.976156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:01.229692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:01.229810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:01.342154 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:01.342331 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:01.527534 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:01.798948 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:01.799581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:01.916634 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.878s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:01.917760 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:01.920869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:01.920869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:01.934165 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:01.935061 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:01.935061 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:01.935061 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:01.935061 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:02.039013 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:02.039495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2003f5df-ed62-46d6-a4ac-707e2f24fc5c', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:02.039819 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3', '192')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:02.041206 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a5aec00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:02.041520 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:02.053317 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:02.063769 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:02.121104 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:02.121373 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:02.124480 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:02.129759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:02.143931 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:02.144081 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:02.155383 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:02.200677 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, portal: 192.168.40.100,3260] Jul 03 02:39:02.200677 np0000004352 cinder-backup[101397]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3, portal: 192.168.40.100,3260] successful. Jul 03 02:39:02.200677 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:02.225887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:02.226598 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:02.226598 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (4187ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:02.402535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:02.402655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:02.522018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:02.522221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:02.762746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:03.030351 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:03.030351 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:03.066325 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:39:03.066325 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:39:03.150235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:03.150235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:03.257691 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-aa5bd0f5-b2cf-4b57-9107-e247a44652ef tempest-ProjectMemberTests33-787641266 None] Create backup finished. backup: 3052116d-a983-42cd-95e3-387c6feafff4. Jul 03 02:39:03.351234 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:03.617553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:03.617553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:03.722451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:03.722451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:03.882452 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] Delete backup started, backup: 3052116d-a983-42cd-95e3-387c6feafff4. Jul 03 02:39:03.887908 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:03.888498 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:03.888893 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] delete started, backup: 3052116d-a983-42cd-95e3-387c6feafff4, container: volumebackups, prefix: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:39:03.919794 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:03.968752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00001', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00002', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00003', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00004', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00005', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00006', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00007', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00008', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00009', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00010', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00011', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00012', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00013', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00014', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00015', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00016', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00017', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00018', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00019', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00020', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00021', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_metadata', 'volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:39:03.998529 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.027469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.049479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.072447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.099681 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.122530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.149758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.171520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.173821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:04.173990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:04.191436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.212757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.236600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.259936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.281291 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.290377 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:04.290571 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:04.318713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.329852 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:04.350978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.376888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.401993 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.430739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.458659 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.495203 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.518015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.530846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:04.539714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.580969 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_6e4d6d52-a6c8-4e26-bd1e-42a1698fa3a3/20260703023845/az_nova_backup_3052116d-a983-42cd-95e3-387c6feafff4_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:04.581214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] delete 3052116d-a983-42cd-95e3-387c6feafff4 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:39:04.604640 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] Created reservations ['2a097ab3-fd49-453a-b4bf-5a295da44c90', '88b668a8-29f1-4420-b85c-f1ad0ace5e1a'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:39:04.625790 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a56ff1ae-3677-44b0-87e2-292232dfbec8 tempest-ProjectMemberTests33-787641266 None] Delete backup finished, backup 3052116d-a983-42cd-95e3-387c6feafff4 deleted. Jul 03 02:39:04.831009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:04.831220 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:04.977547 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:04.977774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:05.186082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:05.453318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:05.453536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:05.571837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:05.572000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:05.780594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:06.055651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:06.055865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:06.166334 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:06.166517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:06.392723 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Create backup started, backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f volume: af4329d7-883a-4712-9032-32fc21d07b6b. Jul 03 02:39:06.402523 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:06.403885 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:39:06Z,data_timestamp=2026-07-03T02:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1314190489',encryption_key_id=None,fail_reason=None,host='np0000004352',id=45fe306c-940f-49ea-ab0e-4587bb19bb8f,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1ed6c153b2ca44cf95e04650aabfde9a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6c9ee0ec801d4d27b460644fb71313d7',volume_id=af4329d7-883a-4712-9032-32fc21d07b6b) Jul 03 02:39:06.432598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:06.432862 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:06.433261 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:06.445031 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:06.467102 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:06.483474 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:06.483794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:06.491296 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:06.492773 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe47:b050', 'fe80::fc16:3eff:fe39:503b'] Jul 03 02:39:06.492981 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:06.493406 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:06.493723 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:06.660113 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:06.660402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:06.788254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:06.788254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:06.847916 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:06.997138 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:06.997543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af4329d7-883a-4712-9032-32fc21d07b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:06.997690 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:06.998096 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:06.998298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af4329d7-883a-4712-9032-32fc21d07b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:07.010834 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:07.011374 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:07.011796 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:07.022864 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:07.022864 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b] added Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:07.034435 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:07.034666 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:07.035114 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:07.035354 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:07.051811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:07.321973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:07.322131 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:07.438720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:07.439053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:07.542954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:07.672539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:07.672706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:07.736910 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:07.737072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:07.745968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:39:07.758786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:39:07.758928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:39:07.763874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:39:07.764009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:39:07.767633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:39:07.767960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:39:07.834903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:39:07.835747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:39:07.869204 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "77e55999-146b-4da7-b742-ab2ff07bad68",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1276278632",\n "created_at": "2026-07-03 02:38:52+00:00",\n "objects": [\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "f5452404-0af7-40c2-893e-59b3d054dcc7",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"f5452404-0af7-40c2-893e-59b3d054dcc7\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:38:51.000000\\", \\"launched_at\\": \\"2026-07-03T02:38:51.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1396909377\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:38:51.000000\\", \\"updated_at\\": \\"2026-07-03T02:38:52.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:39:07.876810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] backup 77e55999-146b-4da7-b742-ab2ff07bad68 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:39:08.038762 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:08.047434 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:08.056697 np0000004352 sudo[154759]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm Jul 03 02:39:08.057390 np0000004352 sudo[154759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:08.060228 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:08.072021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.091863 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.092561 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:08.139200 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b, portal: 192.168.40.100,3260] Jul 03 02:39:08.139200 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b, portal: 192.168.40.100,3260] successful. Jul 03 02:39:08.139200 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:08.150658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:08.175384 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:08.175837 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:08.176213 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:08.176213 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:08.177595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] HCTL ('13', '-', '-', 0) found on session 200 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:08.177723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:08.191471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 200 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:08.191471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af4329d7-883a-4712-9032-32fc21d07b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:08.421600 np0000004352 sudo[154759]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:08.423361 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdm" returned: 0 in 0.385s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:08.423915 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799207', 'path': '/dev/sdm'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:08.424091 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:09.194566 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.196s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:09.195021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (2197ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799208', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:09.195239 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:09.201367 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.776s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:09.202462 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:09.213285 np0000004352 sudo[154868]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:39:09.213993 np0000004352 sudo[154868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:09.215998 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:09.217095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:09.217095 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:09.217095 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:09.217095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:09.251428 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc2ea2a7-61ce-4bbc-9c4f-673f32c1ff88', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', '200')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:09.252050 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '195')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:09.253101 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a868900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7'): ({'sdm'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:09.253327 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdm {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:09.264411 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdm {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:09.273208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:09.321113 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdm have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:09.321301 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdm have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:09.322904 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdm'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:09.334792 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdm'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:09.335070 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:09.347344 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:09.389929 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] Jul 03 02:39:09.389929 np0000004352 cinder-backup[101397]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] successful. Jul 03 02:39:09.389929 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:09.412325 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:09.412633 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.212s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:09.412800 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (989ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:09.599031 np0000004352 sudo[154868]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:09.600961 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.406s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:09.610616 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _create_container started, container: volumebackups,backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:39:09.646162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] generate_object_name_prefix: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:39:09.652835 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] starting backup of volume: af4329d7-883a-4712-9032-32fc21d07b6b, volume size: 1073741824, object names prefix volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:39:09.856770 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:10.097263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:10.097513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:10.199414 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:10.199843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:10.379801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:10.432700 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3ab00214-9b54-453d-9ebf-2ac60fb60e31 tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: 77e55999-146b-4da7-b742-ab2ff07bad68. Jul 03 02:39:10.644055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:10.644231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:10.753028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:10.753249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:10.962137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:11.229272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:11.229272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:11.344717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:11.344903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:11.447544 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Restore backup started, backup: 77e55999-146b-4da7-b742-ab2ff07bad68 volume: f5452404-0af7-40c2-893e-59b3d054dcc7. Jul 03 02:39:11.460672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:11.461406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:11.461406 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:11.473274 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:11.505949 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:11.521477 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:11.521708 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:11.530532 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:11.532095 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe10:8e8a', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b'] Jul 03 02:39:11.532431 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:11.532633 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:11.533017 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:11.564088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:11.847866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:11.848088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:11.958347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:11.958820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:11.991603 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:12.201180 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:12.468435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:12.468890 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:12.540525 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:12.540877 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:12.541030 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:12.541469 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:12.541651 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:12.553764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:12.554202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:12.554494 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:12.566237 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:12.566237 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:12.570794 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:12.571004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7] added Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:12.577623 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:12.577905 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:12.578192 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:12.578374 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:12.809165 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:13.086125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:13.086268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:13.214541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:13.214541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:13.441198 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:13.579390 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:13.592158 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:13.602207 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:13.621530 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:13.622092 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:13.671148 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] Jul 03 02:39:13.671148 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] successful. Jul 03 02:39:13.671148 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:13.682870 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:13.700239 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5a4940d-9585-44a3-a845-2942f4146b74 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:13.700599 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:13.700894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:13.700894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:13.702032 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] HCTL ('9', '-', '-', 0) found on session 201 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:13.702165 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:13.708709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:13.708965 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:13.716627 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 201 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:13.718168 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:13.818876 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:13.819685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:14.007153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:14.276653 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:14.277113 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:14.381346 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:14.381516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:14.579930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:14.721067 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.179s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:14.721275 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2180ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799207', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:14.721623 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:14.746785 np0000004352 sudo[155041]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:39:14.747712 np0000004352 sudo[155041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:14.840056 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:14.840339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:14.958641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:14.958773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:15.119582 np0000004352 sudo[155041]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:15.121529 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.400s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:15.122022 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] starting restore of backup volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68 container: volumebackups, to existing volume f5452404-0af7-40c2-893e-59b3d054dcc7, backup: 77e55999-146b-4da7-b742-ab2ff07bad68. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:39:15.122279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] _read_metadata started, container name: volumebackups, metadata filename: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] _read_metadata finished. Metadata: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "backup_id": "77e55999-146b-4da7-b742-ab2ff07bad68", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1276278632", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:38:52+00:00", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021": { Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: ], Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_id": "f5452404-0af7-40c2-893e-59b3d054dcc7", Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"f5452404-0af7-40c2-893e-59b3d054dcc7\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"106d3bc2bae34ea2bcada267bec638ad\", \"project_id\": \"5b2cdb72840643d690a329de32482c4b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:38:51.000000\", \"launched_at\": \"2026-07-03T02:38:51.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1396909377\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:38:51.000000\", \"updated_at\": \"2026-07-03T02:38:52.000000\"}}" Jul 03 02:39:15.138875 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:39:15.142083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:39:15.142083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] _read_metadata started, container name: volumebackups, metadata filename: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] _read_metadata finished. Metadata: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "backup_id": "77e55999-146b-4da7-b742-ab2ff07bad68", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1276278632", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:38:52+00:00", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021": { Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: } Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: ], Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_id": "f5452404-0af7-40c2-893e-59b3d054dcc7", Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"f5452404-0af7-40c2-893e-59b3d054dcc7\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"106d3bc2bae34ea2bcada267bec638ad\", \"project_id\": \"5b2cdb72840643d690a329de32482c4b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:38:51.000000\", \"launched_at\": \"2026-07-03T02:38:51.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1396909377\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:38:51.000000\", \"updated_at\": \"2026-07-03T02:38:52.000000\"}}" Jul 03 02:39:15.154566 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:39:15.160992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of 77e55999-146b-4da7-b742-ab2ff07bad68 started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:39:15.160992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] metadata_object_names = ['volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:39:15.162582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:15.204749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:39:15.210149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:15.224776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:15.432197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:15.432197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:15.654166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:15.654666 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:15.684597 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:15.703660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:15.925579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:16.169473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:16.187737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:16.194385 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:16.194644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:16.307100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:16.307277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:16.667190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:16.670200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:16.689018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:16.918825 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:16.919054 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:17.100015 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:17.121187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:17.176941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:17.177152 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:17.397513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:17.571069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:17.585514 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:17.664159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:17.664366 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:17.799465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:17.799899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:18.177839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:18.199600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:18.224256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:18.653749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:18.653749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:18.663956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:18.696151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:18.788649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:18.788649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:19.213995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:19.235558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:19.257530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:19.659104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:19.659254 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:19.663732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:19.689558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:19.776918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:19.778005 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:20.113715 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:20.117259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:20.132393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:20.370182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:20.370555 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:20.599019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:20.624644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:20.683336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:20.683336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:20.983746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:21.319169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:21.319365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:21.324906 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:21.353191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:21.439976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:21.440494 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:21.708446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:21.877594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:21.901912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:21.973524 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:21.973709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:22.122335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:22.122335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:22.421834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:22.444928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:22.461514 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:22.895512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:22.895704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:22.901116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:22.925265 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:23.008117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:23.008273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:23.326374 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:23.329606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:23.345402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:23.581887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:23.581887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:23.745234 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:23.781305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:23.876345 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:23.876498 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:24.012257 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:24.222219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:24.222447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:24.233343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:24.253394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:24.298640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:24.298808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:24.305980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:39:24.312040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:39:24.312178 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:39:24.316202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:39:24.316354 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:39:24.321276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:39:24.321569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:39:24.380130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:39:24.381128 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _write_metadata started, container name: volumebackups, metadata filename: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:39:24.452138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "45fe306c-940f-49ea-ab0e-4587bb19bb8f",\n "backup_name": "tempest-type-Backup-1314190489",\n "created_at": "2026-07-03 02:39:06+00:00",\n "objects": [\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "af4329d7-883a-4712-9032-32fc21d07b6b",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"af4329d7-883a-4712-9032-32fc21d07b6b\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6c9ee0ec801d4d27b460644fb71313d7\\", \\"project_id\\": \\"1ed6c153b2ca44cf95e04650aabfde9a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:39:05.000000\\", \\"launched_at\\": \\"2026-07-03T02:39:05.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1658581619\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:39:05.000000\\", \\"updated_at\\": \\"2026-07-03T02:39:06.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:39:24.462711 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] backup 45fe306c-940f-49ea-ab0e-4587bb19bb8f finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:39:24.589368 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:24.613307 np0000004352 sudo[155662]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:39:24.614039 np0000004352 sudo[155662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:24.756752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:24.780472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:24.964571 np0000004352 sudo[155662]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:24.974875 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.386s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:24.975359 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af4329d7-883a-4712-9032-32fc21d07b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799208', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:24.975554 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:24.976056 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:24.976381 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af4329d7-883a-4712-9032-32fc21d07b6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:24.991029 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:24.992287 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:24.992287 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:24.992287 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:24.992287 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.173846 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:25.174362 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '205')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:25.174740 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b', '200')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:25.176070 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a537600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:25.176353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:25.180398 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, object name: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021, volume: f5452404-0af7-40c2-893e-59b3d054dcc7. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:25.189448 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:25.200007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:25.200532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:25.250855 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:25.251026 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:25.252354 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:25.265292 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:25.265636 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:25.299324 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:25.395400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of 77e55999-146b-4da7-b742-ab2ff07bad68 finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:39:25.396095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:39:25.397479 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b, portal: 192.168.40.100,3260] Jul 03 02:39:25.397479 np0000004352 cinder-backup[101397]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-af4329d7-883a-4712-9032-32fc21d07b6b, portal: 192.168.40.100,3260] successful. Jul 03 02:39:25.397479 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:25.402317 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_name' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:39:25.402480 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_description' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:39:25.408096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:39:25.408230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:39:25.408393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] restore 77e55999-146b-4da7-b742-ab2ff07bad68 to f5452404-0af7-40c2-893e-59b3d054dcc7 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:39:25.607587 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:25.614202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:25.614885 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.639s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:25.615037 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (639ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:25.624935 np0000004352 sudo[155697]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:39:25.625617 np0000004352 sudo[155697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:25.929457 np0000004352 sudo[155697]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:25.931228 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.324s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:25.931732 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799207', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:25.931926 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:25.932341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:25.932788 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5452404-0af7-40c2-893e-59b3d054dcc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:25.945605 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:25.946510 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:25.946510 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:25.946510 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:25.946510 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.977892 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '201'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '205')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:25.978408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7', '201')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:25.979740 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x783585390d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:25.979948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:25.991891 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:26.003947 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:26.048894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:26.049063 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:26.050467 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:26.062099 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:26.062412 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:26.073440 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:26.105308 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] Jul 03 02:39:26.105308 np0000004352 cinder-backup[101397]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-f5452404-0af7-40c2-893e-59b3d054dcc7, portal: 192.168.40.100,3260] successful. Jul 03 02:39:26.105308 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:26.127248 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:26.127480 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.195s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:26.127631 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (195ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:26.642045 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e9371d61-8cad-44b5-94a9-f29a45471988 tempest-ProjectMemberTests33-787641266 None] Create backup finished. backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f. Jul 03 02:39:26.906088 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d855023d-6982-4b03-b0eb-e307c41ef9d1 tempest-ProjectMemberTests33-787641266 None] Export record started, backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f. Jul 03 02:39:26.912055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d855023d-6982-4b03-b0eb-e307c41ef9d1 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:26.912209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d855023d-6982-4b03-b0eb-e307c41ef9d1 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:26.912540 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d855023d-6982-4b03-b0eb-e307c41ef9d1 tempest-ProjectMemberTests33-787641266 None] Export record finished, backup 45fe306c-940f-49ea-ab0e-4587bb19bb8f exported. Jul 03 02:39:27.167972 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:27.173396 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Encryption key ID for volume f5452404-0af7-40c2-893e-59b3d054dcc7 already matches encryption key ID in backup 77e55999-146b-4da7-b742-ab2ff07bad68. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:39:27.192955 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8675fb09-d211-4c54-9d94-45920546cb9a tempest-VolumesBackupsTest-1892682639 None] Finished restoring backup 77e55999-146b-4da7-b742-ab2ff07bad68 to volume f5452404-0af7-40c2-893e-59b3d054dcc7. Jul 03 02:39:27.934889 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: 77e55999-146b-4da7-b742-ab2ff07bad68. Jul 03 02:39:27.943810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:27.944188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:27.944549 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] delete started, backup: 77e55999-146b-4da7-b742-ab2ff07bad68, container: volumebackups, prefix: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:39:27.992190 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata', 'volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:39:28.015245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.040479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.065862 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.087050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.109276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.140842 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.172512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.201170 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.224473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.252446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.276549 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.304050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.331942 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.355787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.381045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.406039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.432631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.456240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.480765 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.515367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.554282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.598519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.626618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_f5452404-0af7-40c2-893e-59b3d054dcc7/20260703023855/az_nova_backup_77e55999-146b-4da7-b742-ab2ff07bad68_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:39:28.627181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] delete 77e55999-146b-4da7-b742-ab2ff07bad68 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:39:28.660396 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:28.676079 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] Created reservations ['462b2387-dabf-4256-b389-7838729cf73c', 'ad8d619b-0985-4dd4-b333-165340c85368'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:39:28.692501 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-66e43c2b-9c6d-42e4-a8ea-09d101fc3a08 tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup 77e55999-146b-4da7-b742-ab2ff07bad68 deleted. Jul 03 02:39:29.940527 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Create backup started, backup: 9598bc10-8708-448c-98c7-3f6e07e4feb7 volume: 7b931626-efe2-4886-9055-fccbcbe54ac0. Jul 03 02:39:29.947700 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:39:29Z,data_timestamp=2026-07-03T02:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-314537476',encryption_key_id=None,fail_reason=None,host='np0000004352',id=9598bc10-8708-448c-98c7-3f6e07e4feb7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1ed6c153b2ca44cf95e04650aabfde9a',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='6c9ee0ec801d4d27b460644fb71313d7',volume_id=7b931626-efe2-4886-9055-fccbcbe54ac0) Jul 03 02:39:29.979486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:29.979705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:29.980106 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:29.990925 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:30.014567 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:30.028524 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:30.028864 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:30.037909 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:30.039131 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe3f:b9a1', 'fe80::b0e7:d1ff:fe4b:d598'] Jul 03 02:39:30.039318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:30.039526 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:30.039867 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (59ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:30.371276 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:30.377439 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: d905c25c-2355-4eaa-8fa4-369f094500c2 volume: a16a03d7-2af4-4661-ad32-378225bc5650. Jul 03 02:39:30.383375 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:39:30Z,data_timestamp=2026-07-03T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-963539223',encryption_key_id=None,fail_reason=None,host='np0000004352',id=d905c25c-2355-4eaa-8fa4-369f094500c2,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=a16a03d7-2af4-4661-ad32-378225bc5650) Jul 03 02:39:30.409640 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:30.409818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:30.410127 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:30.421701 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:30.440511 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:30.455964 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:30.456346 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:30.467643 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:30.469016 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe3f:b9a1', 'fe80::b0e7:d1ff:fe4b:d598'] Jul 03 02:39:30.469229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:30.469408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:30.469806 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:30.544826 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:30.545315 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b931626-efe2-4886-9055-fccbcbe54ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:30.545583 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:30.699706 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.154s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:30.699921 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b931626-efe2-4886-9055-fccbcbe54ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:30.714608 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:30.715084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:30.715298 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:30.727850 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:30.727850 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0] added Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:30.740502 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:30.740783 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:30.741362 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:30.741631 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:30.974373 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:30.974769 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:30.974769 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:31.745451 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:31.759489 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:31.771648 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.788245 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.788644 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:31.849277 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0, portal: 192.168.40.100,3260] Jul 03 02:39:31.849277 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0, portal: 192.168.40.100,3260] successful. Jul 03 02:39:31.849277 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:31.862188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:31.885460 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:31.885807 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:31.886019 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:31.886083 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:31.887188 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] HCTL ('9', '-', '-', 0) found on session 208 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:31.887307 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:31.901264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 208 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:31.901264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b931626-efe2-4886-9055-fccbcbe54ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:32.903323 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.204s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:32.903736 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (2357ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799212', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:32.903962 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:32.914332 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.936s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:32.915298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:32.922115 np0000004352 sudo[156049]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:39:32.922864 np0000004352 sudo[156049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:32.926890 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:32.927355 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:32.927678 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:32.940279 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:32.940279 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650] added Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:32.950861 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:32.951211 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:32.951561 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:32.951802 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:33.241286 np0000004352 sudo[156049]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:33.243146 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.339s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:33.280909 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:33.286399 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _create_container started, container: volumebackups,backup: 9598bc10-8708-448c-98c7-3f6e07e4feb7. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:39:33.318344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] generate_object_name_prefix: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:39:33.325408 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] starting backup of volume: 7b931626-efe2-4886-9055-fccbcbe54ac0, volume size: 1073741824, object names prefix volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:39:33.570210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:33.811509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:33.811509 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:33.920641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:33.920954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:33.953378 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:33.966358 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:33.982177 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:34.007098 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:34.007597 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:34.059066 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:39:34.059066 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:39:34.059066 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:34.073538 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:34.093495 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:34.093876 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:34.094142 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:34.094142 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:34.095732 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] HCTL ('13', '-', '-', 0) found on session 209 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:34.095850 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:34.111077 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 209 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:34.111077 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:34.129163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:34.394834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:34.394980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:34.498644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:34.498828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:34.689491 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:34.948522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:34.948931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:35.056125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:35.056328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:35.116504 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.205s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:35.116698 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (4141ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799213', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:35.117050 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:35.142434 np0000004352 sudo[156102]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:39:35.143362 np0000004352 sudo[156102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:35.263337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:35.463154 np0000004352 sudo[156102]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:35.464897 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.348s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:35.473185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: d905c25c-2355-4eaa-8fa4-369f094500c2. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:39:35.513945 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:39:35.524924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: a16a03d7-2af4-4661-ad32-378225bc5650, volume size: 1073741824, object names prefix volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:39:35.543976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:35.544104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:35.661877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:35.662249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:35.777210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:35.904713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:36.064866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:36.065270 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:36.150486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:36.150677 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:36.171003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:36.171591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:36.260859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:36.261060 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:36.440020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:36.553916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:36.708159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:36.708340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:36.804467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:36.804467 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:36.844642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:36.844831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:36.930814 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:36.930814 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:37.177811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:37.283533 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:37.469931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:37.470091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:37.577851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:37.577851 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:37.590609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:37.590609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:37.704079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:37.704079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:37.834404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:37.937206 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:38.133295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:38.133461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:38.197751 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:38.198212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:38.248642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:38.248759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:38.318607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:38.318780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:38.522614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:38.601374 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:38.800899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:38.801129 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:38.909541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:38.909803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:38.919912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:38.920618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:39.030972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:39.031175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:39.267642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:39.332123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:39.545438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:39.545594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:39.593656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:39.593819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:39.657352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:39.657592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:39.722934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:39.723083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:39.961613 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:40.029191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:40.216452 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:40.216606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:40.299336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:40.299336 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:40.338072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:40.338397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:40.419975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:40.420119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:40.592791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:40.680487 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:40.847462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:40.847695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:40.922000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:40.922082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:40.960108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:40.960327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:41.045522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:41.045522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:41.155340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:41.253595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:41.428769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:41.429319 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:41.518848 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:41.519063 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:41.534393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:41.534610 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:41.621797 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:41.621948 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:41.768392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:41.862157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:42.026912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:42.027144 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:42.126320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:42.126320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:42.126320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:42.126320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:42.233125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:42.234602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:42.347521 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:42.452140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:42.603003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:42.603156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:42.700979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:42.701146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:42.715713 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:42.715861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:42.810159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:42.810159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:42.967703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:43.065447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:43.235253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:43.235394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:43.352269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:43.352269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:43.372484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:43.372625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:43.489477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:43.489918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:43.551832 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:43.694775 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:43.814882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:43.815025 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:43.929695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:43.929872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:43.960758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:43.960922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:44.099477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:44.099477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:44.150195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:44.322794 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:44.410872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:44.411048 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:44.517798 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:44.518173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:44.572649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:44.572841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:44.685565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:44.685704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:44.714395 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:44.887641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:44.979482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:44.979756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:45.102838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:45.102959 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:45.162134 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:45.162269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:45.277194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:45.277302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:45.306779 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:45.496348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:45.574058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:45.574058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:45.670652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:45.670652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:45.750923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:45.753532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:45.877894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:45.878194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:45.883274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:45.983350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:46.103743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:46.103939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:46.141643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:46.141780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:46.188149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup MD5 for volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:46.188406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:46.200704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:39:46.213069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:39:46.213241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:39:46.221690 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:39:46.221861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:39:46.226502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:39:46.226785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:39:46.249353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:46.249764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:46.299874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:39:46.301202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _write_metadata started, container name: volumebackups, metadata filename: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:39:46.346573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9598bc10-8708-448c-98c7-3f6e07e4feb7",\n "backup_name": "tempest-type-Backup-314537476",\n "created_at": "2026-07-03 02:39:30+00:00",\n "objects": [\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "7b931626-efe2-4886-9055-fccbcbe54ac0",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"7b931626-efe2-4886-9055-fccbcbe54ac0\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"6c9ee0ec801d4d27b460644fb71313d7\\", \\"project_id\\": \\"1ed6c153b2ca44cf95e04650aabfde9a\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:39:29.000000\\", \\"launched_at\\": \\"2026-07-03T02:39:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1764126081\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:39:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:39:30.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:39:46.362201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] backup 9598bc10-8708-448c-98c7-3f6e07e4feb7 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:39:46.513194 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:46.538361 np0000004352 sudo[156558]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:39:46.539329 np0000004352 sudo[156558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:46.560127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:46.808656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:46.809064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:46.851340 np0000004352 sudo[156558]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:46.852945 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.340s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:46.853544 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b931626-efe2-4886-9055-fccbcbe54ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799212', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:46.853731 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:46.854190 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:46.854543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7b931626-efe2-4886-9055-fccbcbe54ac0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:46.868459 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:46.869626 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:46.869626 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:46.869626 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:46.869626 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:46.898122 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [208] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '213')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:46.898666 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0', '208')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:46.899949 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a7f6520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:46.900173 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:46.910264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:46.914947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:46.915101 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:46.920068 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:46.960166 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:46.960500 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:46.962686 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:46.974525 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:46.974833 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:46.986350 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:47.035195 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0, portal: 192.168.40.100,3260] Jul 03 02:39:47.035195 np0000004352 cinder-backup[101397]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-7b931626-efe2-4886-9055-fccbcbe54ac0, portal: 192.168.40.100,3260] successful. Jul 03 02:39:47.035195 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:47.063009 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:47.063330 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.209s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:47.063542 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (209ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:47.114520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:47.383817 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:47.383976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:47.517188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:47.517343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:47.786761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:48.064687 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:48.064687 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:48.086457 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dea3ecdf-a13b-4dae-a552-8b2cd63606d8 tempest-ProjectMemberTests33-787641266 None] Create backup finished. backup: 9598bc10-8708-448c-98c7-3f6e07e4feb7. Jul 03 02:39:48.179519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:48.179519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:48.290324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:39:48.415136 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:39:48.415698 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:39:48.485322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:39:48.485505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:39:48.492393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:39:48.498533 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:39:48.498682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:39:48.502759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:39:48.502973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:39:48.506960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:39:48.507309 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:39:48.593312 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:39:48.594164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:39:48.627277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "d905c25c-2355-4eaa-8fa4-369f094500c2",\n "backup_name": "tempest-VolumesBackupsTest-Backup-963539223",\n "created_at": "2026-07-03 02:39:30+00:00",\n "objects": [\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "a16a03d7-2af4-4661-ad32-378225bc5650",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a16a03d7-2af4-4661-ad32-378225bc5650\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:39:29.000000\\", \\"launched_at\\": \\"2026-07-03T02:39:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1527815650\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:39:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:39:30.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:39:48.634897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] backup d905c25c-2355-4eaa-8fa4-369f094500c2 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:39:48.766854 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:48.784820 np0000004352 sudo[156699]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:39:48.785462 np0000004352 sudo[156699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:49.150096 np0000004352 sudo[156699]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:49.152798 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.386s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:49.153657 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799213', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:49.153972 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:49.154875 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:49.155562 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:39:49.172469 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:49.173595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:39:49.173595 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:39:49.173595 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:39:49.173595 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:49.209742 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:49.210386 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '207'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '213')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:39:49.211005 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '209')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:39:49.212692 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a5362a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:39:49.213042 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:39:49.228086 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:39:49.238513 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:39:49.293316 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:39:49.293532 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:39:49.295482 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:39:49.312843 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:39:49.313201 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:39:49.327570 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:49.376449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:39:49.376449 np0000004352 cinder-backup[101397]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:39:49.376449 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:49.406844 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:49.408442 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:49.408442 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (253ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:50.443639 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-20cc083c-5570-4735-81ca-f8ea13cfbbb3 tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: d905c25c-2355-4eaa-8fa4-369f094500c2. Jul 03 02:39:50.836319 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Restore backup started, backup: 37d5523e-fb4e-4303-b716-fc6e904976e1 volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. Jul 03 02:39:50.862736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:50.863057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:50.863400 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:50.875961 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:50.900832 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:50.913387 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:50.913857 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:50.923943 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:50.925587 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe3f:b9a1', 'fe80::b0e7:d1ff:fe4b:d598', 'fe80::fc16:3eff:fe7b:eaa', 'fe80::fc16:3eff:fe06:83fa', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe04:bf27', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:39:50.925713 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:50.925856 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:50.926117 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:51.002230 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:51.010309 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: ab28a405-428f-447d-8abe-4e5b33c33389 volume: a16a03d7-2af4-4661-ad32-378225bc5650. Jul 03 02:39:51.016467 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:39:50Z,data_timestamp=2026-07-03T02:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1544661571',encryption_key_id=None,fail_reason=None,host='np0000004352',id=ab28a405-428f-447d-8abe-4e5b33c33389,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(d905c25c-2355-4eaa-8fa4-369f094500c2),parent_id='d905c25c-2355-4eaa-8fa4-369f094500c2',project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=a16a03d7-2af4-4661-ad32-378225bc5650) Jul 03 02:39:51.042221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:39:51.042390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:39:51.042697 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:51.055230 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:39:51.075388 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:51.089634 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:39:51.090024 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:39:51.098038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:39:51.099733 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe3f:b9a1', 'fe80::b0e7:d1ff:fe4b:d598', 'fe80::fc16:3eff:fe7b:eaa', 'fe80::fc16:3eff:fe06:83fa', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe04:bf27', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:39:51.099906 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:39:51.100062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:39:51.100372 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (57ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:51.604827 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:51.605278 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:51.605616 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:51.606129 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:51.606350 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:51.617386 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:51.617832 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:51.618099 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:51.630002 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:51.630002 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650] added Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:51.643329 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:51.643606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:51.644130 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:51.644343 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:51.933154 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:39:51.933750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:39:51.934391 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:52.645541 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:52.662807 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:52.677253 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.698853 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.699237 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:52.753867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:39:52.753867 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:39:52.753867 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:52.766722 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:52.791502 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:52.791851 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:52.792221 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:52.792221 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:52.794040 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] HCTL ('9', '-', '-', 0) found on session 214 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:52.794040 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:52.817361 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 214 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:52.817361 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:53.823228 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.217s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:53.823639 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2217ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799213', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:53.823764 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:53.830658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.896s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:53.831193 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:39:53.841389 np0000004352 sudo[156892]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:39:53.842065 np0000004352 sudo[156892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:53.842572 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:39:53.843098 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:39:53.844082 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:53.856500 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:39:53.856500 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1] added Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:39:53.867636 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:53.868192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:39:53.868408 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:39:53.870283 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:39:54.181346 np0000004352 sudo[156892]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:54.183298 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.359s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:54.234369 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:39:54.235621 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:39:54.272316 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:39:54.279082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: ab28a405-428f-447d-8abe-4e5b33c33389. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:39:54.311027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:39:54.317957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: a16a03d7-2af4-4661-ad32-378225bc5650, volume size: 1073741824, object names prefix volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:39:54.870024 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:39:54.885994 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:54.903978 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:54.932709 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:54.989267 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, portal: 192.168.40.100,3260] Jul 03 02:39:54.989267 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, portal: 192.168.40.100,3260] successful. Jul 03 02:39:54.989267 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:55.000570 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:39:55.030481 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:39:55.031428 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:55.031428 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:39:55.037455 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] HCTL ('13', '-', '-', 0) found on session 215 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:39:55.038509 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Scanning host 13 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:39:55.063965 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Searching for a device in session 215 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:39:55.064262 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:39:55.950834 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=183,cinder:UPDATE=43,cinder:INSERT=4 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:39:56.072051 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.242s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:39:56.072314 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] <== connect_volume: return (4138ms) {'type': 'block', 'scsi_wwn': '330000000d117c0b1', 'path': '/dev/sdh'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:39:56.072744 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:39:56.097658 np0000004352 sudo[156955]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh Jul 03 02:39:56.098367 np0000004352 sudo[156955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:39:56.437725 np0000004352 sudo[156955]: pam_unix(sudo:session): session closed for user root Jul 03 02:39:56.440083 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdh" returned: 0 in 0.367s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:39:56.440562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] starting restore of backup volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1 container: volumebackups, to new volume 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, backup: 37d5523e-fb4e-4303-b716-fc6e904976e1. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:39:56.440847 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] _read_metadata started, container name: volumebackups, metadata filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] _read_metadata finished. Metadata: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "backup_id": "37d5523e-fb4e-4303-b716-fc6e904976e1", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "backup_name": "tempest-type-Backup-312805689", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:38:00+00:00", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021": { Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: ], Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_id": "12be2b98-4c51-43c5-817a-0c0e39aa1dcf", Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"12be2b98-4c51-43c5-817a-0c0e39aa1dcf\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6c9ee0ec801d4d27b460644fb71313d7\", \"project_id\": \"1ed6c153b2ca44cf95e04650aabfde9a\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:37:59.000000\", \"launched_at\": \"2026-07-03T02:37:59.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1375138082\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:37:59.000000\", \"updated_at\": \"2026-07-03T02:38:00.000000\"}}" Jul 03 02:39:56.457307 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:39:56.463082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:39:56.463082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] _read_metadata started, container name: volumebackups, metadata filename: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] _read_metadata finished. Metadata: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "backup_id": "37d5523e-fb4e-4303-b716-fc6e904976e1", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "backup_name": "tempest-type-Backup-312805689", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:38:00+00:00", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021": { Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: } Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: ], Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_id": "12be2b98-4c51-43c5-817a-0c0e39aa1dcf", Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"12be2b98-4c51-43c5-817a-0c0e39aa1dcf\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"6c9ee0ec801d4d27b460644fb71313d7\", \"project_id\": \"1ed6c153b2ca44cf95e04650aabfde9a\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:37:59.000000\", \"launched_at\": \"2026-07-03T02:37:59.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumeV3RbacBaseTests-Volume-1375138082\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:37:59.000000\", \"updated_at\": \"2026-07-03T02:38:00.000000\"}}" Jul 03 02:39:56.483260 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:39:56.488578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] v1 volume backup restore of 37d5523e-fb4e-4303-b716-fc6e904976e1 started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:39:56.488578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] metadata_object_names = ['volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:39:56.536799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:39:56.540895 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:56.557432 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:56.904721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:56.922019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:57.277814 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:57.297201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:57.629763 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:57.649989 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:58.013907 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:58.037667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:58.394744 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:58.415703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:58.853541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:58.872674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:59.410285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:59.426793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:59.805275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:39:59.820208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:39:59.986726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:40:00.191914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:40:00.192054 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:40:00.226854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:40:00.226980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:40:00.231138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:00.231880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:40:00.232006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:40:00.274378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:00.324829 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:40:00.325703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:40:00.361649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ab28a405-428f-447d-8abe-4e5b33c33389",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1544661571",\n "created_at": "2026-07-03 02:39:51+00:00",\n "objects": [],\n "parent_id": "d905c25c-2355-4eaa-8fa4-369f094500c2",\n "version": "1.0.0",\n "volume_id": "a16a03d7-2af4-4661-ad32-378225bc5650",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"a16a03d7-2af4-4661-ad32-378225bc5650\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:39:29.000000\\", \\"launched_at\\": \\"2026-07-03T02:39:29.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1527815650\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:39:29.000000\\", \\"updated_at\\": \\"2026-07-03T02:39:51.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:40:00.371732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] backup ab28a405-428f-447d-8abe-4e5b33c33389 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:40:00.519394 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:00.543876 np0000004352 sudo[157230]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:40:00.544804 np0000004352 sudo[157230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:00.662925 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:00.678342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:00.848152 np0000004352 sudo[157230]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:01.002050 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.483s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:01.002494 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799213', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:01.002658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:01.007439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:01.021685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:01.402172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:01.426160 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:01.824184 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:01.839266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:02.171813 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.169s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:02.172445 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:40:02.177768 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:02.186539 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:02.188264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:40:02.188264 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:40:02.188264 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:40:02.188264 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:40:02.193548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:02.224173 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '217')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:40:02.224966 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '214')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:40:02.226511 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a906a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:40:02.226826 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:40:02.239710 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:40:02.248614 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:40:02.296912 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:40:02.297074 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:40:02.298664 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:40:02.311447 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:40:02.311731 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:40:02.323791 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:02.387660 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:40:02.387660 np0000004352 cinder-backup[101397]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:40:02.387660 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:02.517803 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:02.518212 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:02.518490 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (1515ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:02.525503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:02.542578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:02.943957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:02.961199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:03.068639 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:40:03.068796 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:40:03.320782 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:03.338544 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:03.679438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:03.700033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:03.703319 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-87975a4b-f6a0-452d-9284-62f0943fe1f5 tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: ab28a405-428f-447d-8abe-4e5b33c33389. Jul 03 02:40:04.083747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:04.110575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:04.437276 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Restore backup started, backup: ab28a405-428f-447d-8abe-4e5b33c33389 volume: a16a03d7-2af4-4661-ad32-378225bc5650. Jul 03 02:40:04.447007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:04.447172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:04.447370 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:04.451140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restoring object. backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, object name: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021, volume: 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:04.457336 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:40:04.470577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:04.479316 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:04.492134 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:40:04.492134 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:40:04.500750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:40:04.502029 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe7b:eaa', 'fe80::fc16:3eff:fe06:83fa', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe04:bf27', 'fe80::70ce:aeff:fe58:123b'] Jul 03 02:40:04.502246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:40:04.502402 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:40:04.502746 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:04.634297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] v1 volume backup restore of 37d5523e-fb4e-4303-b716-fc6e904976e1 finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:40:04.634521 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:40:04.668416 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:04.673622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Excluding field 'display_name' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:04.673736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Excluding field 'display_description' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:04.679865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:04.679974 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:04.680150 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] restore 37d5523e-fb4e-4303-b716-fc6e904976e1 to 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:40:04.680523 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:04.698785 np0000004352 sudo[157463]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh Jul 03 02:40:04.699495 np0000004352 sudo[157463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:05.046093 np0000004352 sudo[157463]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:05.048286 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdh" returned: 0 in 0.367s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:05.048882 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000d117c0b1', 'path': '/dev/sdh'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:05.049047 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:05.511477 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:40:05.511985 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:05.511985 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:05.811116 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.762s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:05.811557 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:05.826214 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:05.827821 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:40:05.827821 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:40:05.827821 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:40:05.827821 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:05.862548 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '219')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:40:05.863223 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1', '215')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:40:05.864316 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Resulting device map defaultdict(. at 0x78357a904360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1'): ({'sdh'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:40:05.864567 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Removing single pathed devices sdh {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:40:05.875307 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Flushing IO for device /dev/sdh {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:40:05.885224 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:40:05.931897 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Checking to see if SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:40:05.932105 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] SCSI volumes sdh have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:40:05.933949 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Checking to see if device paths {'sdh'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:40:05.944509 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Device paths {'sdh'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:40:05.944766 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:40:05.959661 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:06.006716 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, portal: 192.168.40.100,3260] Jul 03 02:40:06.006716 np0000004352 cinder-backup[101397]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1, portal: 192.168.40.100,3260] successful. Jul 03 02:40:06.006716 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:06.034482 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:06.034779 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.224s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:06.034983 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] <== disconnect_volume: return (986ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:06.036346 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.524s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:06.037829 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:40:06.049862 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:06.050322 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:06.050597 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:40:06.064780 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:40:06.064780 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650] added Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:40:06.076974 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:06.077225 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:40:06.077567 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:40:06.077783 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:40:07.048413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Encryption key ID for volume 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1 already matches encryption key ID in backup 37d5523e-fb4e-4303-b716-fc6e904976e1. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:40:07.071322 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d6e1c86a-e733-4a12-b2df-5655eab173c6 tempest-ProjectMemberTests33-787641266 None] Finished restoring backup 37d5523e-fb4e-4303-b716-fc6e904976e1 to volume 7bda06cc-a3dd-44eb-84c3-ad34f6bc73b1. Jul 03 02:40:07.079187 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:40:07.091546 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:07.106923 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.130504 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.131202 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:07.193669 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:40:07.193669 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:40:07.193669 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:07.205857 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:07.228554 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:07.231124 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:07.231756 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:07.231853 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:40:07.233431 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] HCTL ('9', '-', '-', 0) found on session 220 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:40:07.233820 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:40:07.249136 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 220 and hctl ['9', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:40:08.252255 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 220 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:40:08.252951 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:40:08.253772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.217s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:08.253772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2741ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799213', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:08.253772 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:08.271766 np0000004352 sudo[157620]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:40:08.272440 np0000004352 sudo[157620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:08.473390 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] Delete backup started, backup: 9598bc10-8708-448c-98c7-3f6e07e4feb7. Jul 03 02:40:08.478439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:08.478608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:08.479712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] delete started, backup: 9598bc10-8708-448c-98c7-3f6e07e4feb7, container: volumebackups, prefix: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:40:08.518517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00001', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00002', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00003', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00004', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00005', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00006', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00007', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00008', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00009', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00010', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00011', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00012', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00013', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00014', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00015', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00016', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00017', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00018', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00019', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00020', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00021', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_metadata', 'volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:08.544137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.569305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.596040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.624062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.647550 np0000004352 sudo[157620]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:08.649977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.651295 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.397s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:08.653237 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] starting restore of backup volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389 container: volumebackups, to existing volume a16a03d7-2af4-4661-ad32-378225bc5650, backup: ab28a405-428f-447d-8abe-4e5b33c33389. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:761}} Jul 03 02:40:08.653520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata finished. Metadata: { Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "backup_id": "ab28a405-428f-447d-8abe-4e5b33c33389", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1544661571", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:39:51+00:00", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "objects": [], Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "parent_id": "d905c25c-2355-4eaa-8fa4-369f094500c2", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "volume_id": "a16a03d7-2af4-4661-ad32-378225bc5650", Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a16a03d7-2af4-4661-ad32-378225bc5650\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"106d3bc2bae34ea2bcada267bec638ad\", \"project_id\": \"5b2cdb72840643d690a329de32482c4b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:39:29.000000\", \"launched_at\": \"2026-07-03T02:39:29.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1527815650\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:39:29.000000\", \"updated_at\": \"2026-07-03T02:39:51.000000\"}}" Jul 03 02:40:08.673776 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:40:08.674182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Restoring backup version 1.0.0 {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:774}} Jul 03 02:40:08.729774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.742075 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:08.747128 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:40:08.754689 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata finished. Metadata: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "backup_id": "d905c25c-2355-4eaa-8fa4-369f094500c2", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-963539223", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:39:30+00:00", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "objects": [ Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 0 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 52428800 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 104857600 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 157286400 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 209715200 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 262144000 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 314572800 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 367001600 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 419430400 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 471859200 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 524288000 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 576716800 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 629145600 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 681574400 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 734003200 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 786432000 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 838860800 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 891289600 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 943718400 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 52428800, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "25e317773f308e446cc84c503a6d1f85", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 996147200 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021": { Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "compression": "zlib", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "length": 25165824, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "md5": "77377273b0a4b61febdbf7bbf52b9db9", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "offset": 1048576000 Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: } Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: ], Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "parent_id": null, Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_id": "a16a03d7-2af4-4661-ad32-378225bc5650", Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a16a03d7-2af4-4661-ad32-378225bc5650\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"106d3bc2bae34ea2bcada267bec638ad\", \"project_id\": \"5b2cdb72840643d690a329de32482c4b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:39:29.000000\", \"launched_at\": \"2026-07-03T02:39:29.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1527815650\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:39:29.000000\", \"updated_at\": \"2026-07-03T02:39:30.000000\"}}" Jul 03 02:40:08.768706 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:40:08.776534 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of d905c25c-2355-4eaa-8fa4-369f094500c2 started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:40:08.776534 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] metadata_object_names = ['volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021']. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:40:08.785856 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.826125 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.829992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_metadata', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:08.835450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:08.854080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:08.856051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.885703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.921801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.951166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:08.985436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.015552 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.067896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.103185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.304925 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.310303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:09.328703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:09.331714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.357436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.387106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.411975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.436760 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_7b931626-efe2-4886-9055-fccbcbe54ac0/20260703023933/az_nova_backup_9598bc10-8708-448c-98c7-3f6e07e4feb7_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.436990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] delete 9598bc10-8708-448c-98c7-3f6e07e4feb7 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:40:09.454549 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] Created reservations ['9cc395ad-4083-4e2b-970f-6165fe10993e', '2b1d0c7b-0ff2-48ac-952c-5eb5b5623ac5'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:40:09.478784 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-bcd88f66-0163-4756-abe4-8d48fd92e5b9 tempest-ProjectMemberTests33-787641266 None] Delete backup finished, backup 9598bc10-8708-448c-98c7-3f6e07e4feb7 deleted. Jul 03 02:40:09.556319 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] Delete backup started, backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f. Jul 03 02:40:09.560003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:09.560269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:09.560501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] delete started, backup: 45fe306c-940f-49ea-ab0e-4587bb19bb8f, container: volumebackups, prefix: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:40:09.616192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00001', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00002', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00003', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00004', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00005', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00006', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00007', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00008', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00009', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00010', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00011', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00012', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00013', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00014', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00015', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00016', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00017', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00018', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00019', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00020', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00021', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_metadata', 'volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:09.808333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.817585 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:09.820964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:09.834369 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:09.835102 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.868764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.893013 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.917355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.943692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:09.970761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.004663 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.082934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.268792 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.278271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:10.295207 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:10.306095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.337511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.373096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.399573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.431584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.455378 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.500700 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.530397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.701319 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.709609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:10.728156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:10.732530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.768739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.800697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.824121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] deleted object: volume_af4329d7-883a-4712-9032-32fc21d07b6b/20260703023909/az_nova_backup_45fe306c-940f-49ea-ab0e-4587bb19bb8f_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:10.824330 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] delete 45fe306c-940f-49ea-ab0e-4587bb19bb8f finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:40:10.843897 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] Created reservations ['1f40a49f-e72d-457e-b296-11c938c07ec1', 'd4d066aa-d886-435e-a251-74526c013e8b'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:40:10.865191 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d89178f8-5189-4d7d-8532-550fcfd5dae6 tempest-ProjectMemberTests33-787641266 None] Delete backup finished, backup 45fe306c-940f-49ea-ab0e-4587bb19bb8f deleted. Jul 03 02:40:11.122522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:11.137593 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:11.517107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:11.536883 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:11.652893 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] Delete backup started, backup: 37d5523e-fb4e-4303-b716-fc6e904976e1. Jul 03 02:40:11.654986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1ed6c153b2ca44cf95e04650aabfde9a {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:11.655158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:11.655374 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] delete started, backup: 37d5523e-fb4e-4303-b716-fc6e904976e1, container: volumebackups, prefix: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:40:11.706285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] generated object list: ['volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata', 'volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:11.774671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:11.949820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.007288 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:12.010548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:12.028624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:12.031135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.058998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.084603 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.112275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.138958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.166193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.234157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.261157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.438901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.444761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:12.459981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:12.467897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.498897 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.524580 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.550006 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.577522 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.607132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.629145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.678936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.713754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.877719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.883655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:12.899898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:12.904527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.929080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] deleted object: volume_12be2b98-4c51-43c5-817a-0c0e39aa1dcf/20260703023803/az_nova_backup_37d5523e-fb4e-4303-b716-fc6e904976e1_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:12.929252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] delete 37d5523e-fb4e-4303-b716-fc6e904976e1 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:40:12.945931 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] Created reservations ['2085eae8-2da8-4c91-8481-776053e70b72', 'c1266213-1ea2-4e30-b72a-f46a4db43a98'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:40:12.969242 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-d9e2d119-f43f-4428-89a4-3d822d4918ba tempest-ProjectMemberTests33-787641266 None] Delete backup finished, backup 37d5523e-fb4e-4303-b716-fc6e904976e1 deleted. Jul 03 02:40:13.305840 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:13.321656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:13.720017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:13.738458 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:14.119416 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:14.135100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:14.502231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:14.517938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:14.880964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:14.895477 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:15.274443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:15.290545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:15.723989 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:15.736781 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:16.114669 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:16.129572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:16.570934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:16.585447 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:17.016987 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:17.032433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:17.435100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restoring object. backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, object name: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021, volume: a16a03d7-2af4-4661-ad32-378225bc5650. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:705}} Jul 03 02:40:17.449274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] decompressing data using zlib algorithm {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:722}} Jul 03 02:40:17.641896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of d905c25c-2355-4eaa-8fa4-369f094500c2 finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:40:17.642118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:40:17.647273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_name' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:17.647753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_description' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:17.653476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:17.653738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:17.653738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata started, container name: volumebackups, metadata filename: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:320}} Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _read_metadata finished. Metadata: { Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "backup_description": null, Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "backup_id": "ab28a405-428f-447d-8abe-4e5b33c33389", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "backup_name": "tempest-VolumesBackupsTest-Backup-1544661571", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "created_at": "2026-07-03 02:39:51+00:00", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "objects": [], Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "parent_id": "d905c25c-2355-4eaa-8fa4-369f094500c2", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "version": "1.0.0", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "volume_id": "a16a03d7-2af4-4661-ad32-378225bc5650", Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: "volume_meta": "{\"version\": 2, \"volume-base-metadata\": {\"id\": \"a16a03d7-2af4-4661-ad32-378225bc5650\", \"_name_id\": null, \"use_quota\": true, \"ec2_id\": null, \"user_id\": \"106d3bc2bae34ea2bcada267bec638ad\", \"project_id\": \"5b2cdb72840643d690a329de32482c4b\", \"snapshot_id\": null, \"cluster_name\": null, \"host\": \"np0000004352@storpool#template_virtual\", \"size\": 1, \"availability_zone\": \"nova\", \"status\": \"backing-up\", \"attach_status\": \"detached\", \"migration_status\": null, \"scheduled_at\": \"2026-07-03T02:39:29.000000\", \"launched_at\": \"2026-07-03T02:39:29.000000\", \"terminated_at\": null, \"display_name\": \"tempest-VolumesBackupsTest-Volume-1527815650\", \"display_description\": null, \"provider_location\": null, \"provider_auth\": null, \"provider_geometry\": null, \"provider_id\": null, \"volume_type_id\": \"cc60d419-a158-4d72-a53e-11fa27beb066\", \"source_volid\": null, \"encryption_key_id\": null, \"consistencygroup_id\": null, \"group_id\": null, \"bootable\": false, \"multiattach\": false, \"replication_status\": null, \"replication_extended_status\": null, \"replication_driver_data\": null, \"previous_status\": \"available\", \"service_uuid\": \"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\", \"shared_targets\": true, \"deleted_at\": null, \"deleted\": false, \"created_at\": \"2026-07-03T02:39:29.000000\", \"updated_at\": \"2026-07-03T02:39:51.000000\"}}" Jul 03 02:40:17.666612 np0000004352 cinder-backup[101397]: }. {{(pid=101397) _read_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:327}} Jul 03 02:40:17.667126 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of ab28a405-428f-447d-8abe-4e5b33c33389 started. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:678}} Jul 03 02:40:17.667126 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] metadata_object_names = []. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:685}} Jul 03 02:40:17.709320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:17.709466 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] v1 volume backup restore of ab28a405-428f-447d-8abe-4e5b33c33389 finished. {{(pid=101397) _restore_v1 /opt/stack/cinder/cinder/backup/chunkeddriver.py:750}} Jul 03 02:40:17.709619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Restoring volume base metadata {{(pid=101397) _restore_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:177}} Jul 03 02:40:17.714061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_name' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:17.714170 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Excluding field 'display_description' {{(pid=101397) _filter /opt/stack/cinder/cinder/backup/driver.py:171}} Jul 03 02:40:17.716238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:17.716360 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] No metadata of type 'volume-glance-metadata' to restore {{(pid=101397) put /opt/stack/cinder/cinder/backup/driver.py:345}} Jul 03 02:40:17.716823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] restore ab28a405-428f-447d-8abe-4e5b33c33389 to a16a03d7-2af4-4661-ad32-378225bc5650 finished. {{(pid=101397) restore /opt/stack/cinder/cinder/backup/chunkeddriver.py:815}} Jul 03 02:40:17.926972 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:17.947894 np0000004352 sudo[157807]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:40:17.948552 np0000004352 sudo[157807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:18.287185 np0000004352 sudo[157807]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:18.289442 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.362s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:18.291335 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799213', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:18.291335 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:18.291335 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:18.291335 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a16a03d7-2af4-4661-ad32-378225bc5650', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:40:18.315239 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:40:18.317770 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:18.353535 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: tcp: [220] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650 (non-flash) Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '212'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '220')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:40:18.354152 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650', '220')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:40:18.355689 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a7f6980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:40:18.355950 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:40:18.368878 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:40:18.376647 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:40:18.427011 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:40:18.427251 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:40:18.430087 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:40:18.440570 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:40:18.441103 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:40:18.456627 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:18.499654 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] Jul 03 02:40:18.499654 np0000004352 cinder-backup[101397]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-a16a03d7-2af4-4661-ad32-378225bc5650, portal: 192.168.40.100,3260] successful. Jul 03 02:40:18.499654 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:18.530382 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:18.530658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.240s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:18.530824 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (240ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:19.544981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.manager [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Encryption key ID for volume a16a03d7-2af4-4661-ad32-378225bc5650 already matches encryption key ID in backup ab28a405-428f-447d-8abe-4e5b33c33389. {{(pid=101397) _run_restore /opt/stack/cinder/cinder/backup/manager.py:873}} Jul 03 02:40:19.566363 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-309d0c1b-4a5b-41ea-9040-1d0d9e7f6b7f tempest-VolumesBackupsTest-1892682639 None] Finished restoring backup ab28a405-428f-447d-8abe-4e5b33c33389 to volume a16a03d7-2af4-4661-ad32-378225bc5650. Jul 03 02:40:19.791981 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: ab28a405-428f-447d-8abe-4e5b33c33389. Jul 03 02:40:19.795633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:19.795783 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:19.795952 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] delete started, backup: ab28a405-428f-447d-8abe-4e5b33c33389, container: volumebackups, prefix: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:40:19.834530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:19.862904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:19.887083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023954/az_nova_backup_ab28a405-428f-447d-8abe-4e5b33c33389_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:19.887311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] delete ab28a405-428f-447d-8abe-4e5b33c33389 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:40:19.920694 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:19.937354 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] Created reservations ['7a12761e-009b-4757-b07b-1096c43c6b32', 'e693f60b-0662-45fb-9776-5a0b84c50de5'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:40:19.983553 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-be893e5f-7ae9-4bd8-8c1e-703c3ffb3cba tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup ab28a405-428f-447d-8abe-4e5b33c33389 deleted. Jul 03 02:40:20.867126 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: d905c25c-2355-4eaa-8fa4-369f094500c2. Jul 03 02:40:20.870342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:20.870649 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:20.870876 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] delete started, backup: d905c25c-2355-4eaa-8fa4-369f094500c2, container: volumebackups, prefix: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:40:20.920484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_metadata', 'volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:40:20.944440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:20.964380 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:20.986670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.007068 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.033214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.056170 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.078197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.103651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.126748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.150296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.173578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.196530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.217741 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.240619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.266195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.291474 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.314129 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.339902 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.362394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.386181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.411262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.430678 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.452036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_a16a03d7-2af4-4661-ad32-378225bc5650/20260703023935/az_nova_backup_d905c25c-2355-4eaa-8fa4-369f094500c2_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:40:21.452252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] delete d905c25c-2355-4eaa-8fa4-369f094500c2 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:40:21.485060 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:21.501664 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] Created reservations ['9157812a-5e5a-4bcc-909a-0711719e4e4c', 'fc0748d0-3464-4639-822e-806cef27390f'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:40:21.527947 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ffdc0459-2dc9-4a1e-b87c-5d98887002eb tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup d905c25c-2355-4eaa-8fa4-369f094500c2 deleted. Jul 03 02:40:23.526926 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: 58eac833-bfed-42fd-94f0-f7e118111aa0 volume: 3911af54-12a2-48da-8a87-0d473084b7c9. Jul 03 02:40:23.534191 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:40:23Z,data_timestamp=2026-07-03T02:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-566353265',encryption_key_id=None,fail_reason=None,host='np0000004352',id=58eac833-bfed-42fd-94f0-f7e118111aa0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=3911af54-12a2-48da-8a87-0d473084b7c9) Jul 03 02:40:23.560194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:40:23.560439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:40:23.560862 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:23.571753 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:40:23.593374 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:23.608886 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:40:23.609342 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:40:23.618223 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:40:23.620217 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe83:307e', 'fe80::2845:a1ff:feac:db94', 'fe80::fc16:3eff:fe04:db50', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe39:503b', 'fe80::fc16:3eff:fe7b:eaa', 'fe80::fc16:3eff:fe06:83fa', 'fe80::4a4:ffff:fe12:1758', 'fe80::fc16:3eff:fe04:bf27', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe11:4f4f', 'fe80::fc16:3eff:fe3f:b9a1', 'fe80::b0e7:d1ff:fe4b:d598'] Jul 03 02:40:23.620396 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:40:23.620642 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:40:23.620996 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (60ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:24.126155 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:40:24.126543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:24.126742 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:24.127206 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:24.127402 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:40:24.140894 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:24.141284 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:24.141514 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:40:24.152752 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:40:24.152752 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9] added Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:40:24.165126 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:24.165434 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:40:24.165897 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:40:24.166230 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:40:25.167491 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:40:25.179449 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:25.194313 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.221504 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.222367 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:25.286111 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] Jul 03 02:40:25.286111 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] successful. Jul 03 02:40:25.286111 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:25.298881 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:40:25.324018 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db940d45-e5cf-44dc-b386-8dd6d8e779a9 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:25.324550 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:25.325049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:40:25.326235 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] HCTL ('9', '-', '-', 0) found on session 221 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:40:25.326365 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Scanning host 9 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:40:25.341380 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 221 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:40:25.342367 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:40:26.347177 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.220s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:26.347661 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2220ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799221', 'path': '/dev/sdd'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:26.347661 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:26.364989 np0000004352 sudo[157984]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd Jul 03 02:40:26.365580 np0000004352 sudo[157984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:26.700277 np0000004352 sudo[157984]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:26.702325 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdd" returned: 0 in 0.354s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:26.735065 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:40:26.741267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: 58eac833-bfed-42fd-94f0-f7e118111aa0. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:40:26.774201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:40:26.782082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: 3911af54-12a2-48da-8a87-0d473084b7c9, volume size: 1073741824, object names prefix volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:40:26.993197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:27.676323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 19825286 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:27.676787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:27.902569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00001: 82571f7121cb9475563edde615e4e4df {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:27.902569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:28.096139 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:28.340656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:28.341243 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:28.451916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:28.451916 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:28.647373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:28.918752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 1362154 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:28.918752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:29.036964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00003: a35891500449df17e893f84bd88472fb {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:29.036964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:29.211091 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:29.468497 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:29.468680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:29.570241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:29.570457 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:29.754245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:29.998911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:29.999374 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:30.107110 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:30.107259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:30.305589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:30.557541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:30.557732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:30.666283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:30.666446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:30.884430 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:31.128007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:31.129627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:31.239483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:31.239646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:31.433788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:31.684192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:31.684384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:31.791342 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:31.791520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:31.977119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:32.226141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:32.226602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:32.347530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:32.347728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:32.553083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:32.813679 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:32.813977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:32.942009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:32.942009 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:33.133365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:33.388028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:33.388340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:33.500582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:33.500582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:33.721343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:34.016930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:34.017212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:34.129294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:34.129455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:34.310960 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:34.563307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:34.563307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:34.672934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:34.672934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:34.863823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:35.117801 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:35.117940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:35.218709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:35.218884 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:35.401057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:35.651300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:35.651300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:35.760915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:35.761167 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:35.969224 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:36.210292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:36.210434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:36.329512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:36.329709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:36.503216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:36.742976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:36.745887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:36.839888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:36.840049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:37.062038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:37.316193 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:37.316394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:37.421280 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:37.421528 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:37.620965 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:37.885338 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:37.885646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:37.988956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:37.989095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:38.184710 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:38.431694 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:38.431840 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:38.534215 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:38.534596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:38.625096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:40:38.755158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:40:38.755158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:40:38.821668 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:40:38.821830 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:40:38.828607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:40:38.834163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:40:38.834318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:40:38.838127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:40:38.838247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:40:38.841371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 02:40:38.841633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:40:38.910860 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:40:38.911634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:40:38.938920 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "58eac833-bfed-42fd-94f0-f7e118111aa0",\n "backup_name": "tempest-VolumesBackupsTest-Backup-566353265",\n "created_at": "2026-07-03 02:40:23+00:00",\n "objects": [\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "82571f7121cb9475563edde615e4e4df",\n "offset": 0\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "a35891500449df17e893f84bd88472fb",\n "offset": 104857600\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "3911af54-12a2-48da-8a87-0d473084b7c9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"3911af54-12a2-48da-8a87-0d473084b7c9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:40:22.000000\\", \\"launched_at\\": \\"2026-07-03T02:40:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-831849675\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:40:22.000000\\", \\"updated_at\\": \\"2026-07-03T02:40:23.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"ea993fc3-c724-45f7-8dae-63cf2cac16e5\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:40:38.946736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] backup 58eac833-bfed-42fd-94f0-f7e118111aa0 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:40:39.082754 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:40:39.098992 np0000004352 sudo[158264]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd Jul 03 02:40:39.099685 np0000004352 sudo[158264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:40:39.448928 np0000004352 sudo[158264]: pam_unix(sudo:session): session closed for user root Jul 03 02:40:39.451149 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdd" returned: 0 in 0.368s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:40:39.452007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799221', 'path': '/dev/sdd'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:40:39.452256 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:40:39.452889 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:40:39.453517 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:40:39.466266 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:39.467150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:40:39.467150 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:40:39.467150 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:40:39.467150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:40:39.498197 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [203] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [219] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:40:39.498744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e9d715e2-816b-46e3-a20f-67f1acf0e365', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0b758447-0a31-4d9e-b3c2-81b9fa37ff51', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92490872-c99a-4e4d-9073-db3500bbaf30', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51009932-6bba-49b8-a3ea-0656f49140d1', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '202'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-429dd433-9df4-442d-8b6e-8422dcc27d05', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ceea6e75-8b35-49f5-a6d8-132740a19327', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '218'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13853f5d-9cc9-4132-8f42-6ab5b7c32250', '219'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', '221')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:40:39.499108 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', '221')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:40:39.500366 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x783584e97a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9'): ({'sdd'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:40:39.500655 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdd {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:40:39.513434 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdd {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:40:39.523628 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:40:39.581835 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:40:39.582014 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdd have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:40:39.583577 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdd'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:40:39.595384 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdd'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:40:39.595699 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:40:39.605516 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:39.657360 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] Jul 03 02:40:39.657360 np0000004352 cinder-backup[101397]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] successful. Jul 03 02:40:39.657360 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:39.678244 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:40:39.678543 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.226s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:40:39.678690 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (226ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:40:40.704639 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-592aa498-8adf-4fec-a08a-1f7fb0ec8070 tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: 58eac833-bfed-42fd-94f0-f7e118111aa0. Jul 03 02:40:50.701041 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=143,cinder:UPDATE=48,cinder:INSERT=11 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:41:03.073042 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:41:03.073042 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:41:06.053153 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:41:44.256892 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: 93e8ce89-165c-4fb2-9b17-38be0cfeef1c volume: 3911af54-12a2-48da-8a87-0d473084b7c9. Jul 03 02:41:44.262162 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:41:44Z,data_timestamp=2026-07-03T02:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1187429120',encryption_key_id=None,fail_reason=None,host='np0000004352',id=93e8ce89-165c-4fb2-9b17-38be0cfeef1c,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(58eac833-bfed-42fd-94f0-f7e118111aa0),parent_id='58eac833-bfed-42fd-94f0-f7e118111aa0',project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=3911af54-12a2-48da-8a87-0d473084b7c9) Jul 03 02:41:44.285889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:41:44.286162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:41:44.286569 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:41:44.296866 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:41:44.319263 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:41:44.330267 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:41:44.330732 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:41:44.338613 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:41:44.339750 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe62:f9b8', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe6b:f9f2', 'fe80::18f9:89ff:fe93:18da', 'fe80::fc16:3eff:fe6f:1e21', 'fe80::b0e7:d1ff:fe4b:d598'] Jul 03 02:41:44.339960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:41:44.340151 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:41:44.340436 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (53ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:41:44.844323 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:41:44.844818 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:41:44.845054 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:41:44.845698 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:41:44.846027 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:41:44.856321 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:41:44.856744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:41:44.857017 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:41:44.868000 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:41:44.868000 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9] added Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:41:44.880807 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:44.881079 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:41:44.881302 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:41:44.881512 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:41:45.883383 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:41:45.897179 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:45.907007 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:45.920511 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.920511 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.920511 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.920511 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.920511 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:41:45.920849 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.920849 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.920849 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.920849 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.920849 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:41:45.964053 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] Jul 03 02:41:45.964053 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] successful. Jul 03 02:41:45.964053 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:45.974518 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:41:45.986496 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:41:45.986801 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:41:45.986992 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:41:45.987089 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:41:45.987759 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] HCTL ('7', '-', '-', 0) found on session 228 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:41:45.987887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:41:46.004828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 228 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:41:46.005028 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:41:47.007706 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.162s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:41:47.008130 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2163ms) {'type': 'block', 'scsi_wwn': '330000000a0c13f6d', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:41:47.008191 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:41:47.024937 np0000004352 sudo[160340]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:41:47.025581 np0000004352 sudo[160340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:41:47.334577 np0000004352 sudo[160340]: pam_unix(sudo:session): session closed for user root Jul 03 02:41:47.336573 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.328s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:41:47.371512 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:41:47.375888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:41:47.424301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:41:47.430684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: 93e8ce89-165c-4fb2-9b17-38be0cfeef1c. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:41:47.451228 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:41:47.461530 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: 3911af54-12a2-48da-8a87-0d473084b7c9, volume size: 1073741824, object names prefix volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:41:47.684673 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.685626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 639 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.685827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.711372 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00001: 7455b0146d203e0450dd14035351df50 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.711541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.711930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.718048 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 294912 bytes of data to 26854 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.718189 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.743532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00002: fa9ce028f3d6fc909d3fa99b3a5f338c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.743701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.745473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.767251 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 2195456 bytes of data to 112198 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.767429 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.801245 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00003: 3cc4787abec81defebbb7b2b01cbac43 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.801416 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.801944 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.803260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 3974 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.803385 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.826708 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00004: e1554f9208060479cb8c0e2b20ce3092 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.826938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.827574 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.833108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 360448 bytes of data to 34483 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.833287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.858923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00005: 260e04b2b4be4a8fb9af5bcaeef77f5e {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.859132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.859736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.865544 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 36108 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.865740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.905901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00006: 7e4882497657c646c554c5ad835c0cf5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.906109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.906460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.907106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 338 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.907332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.938589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00007: d9cd9a4fb7c178bffad872b9fd1c6616 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.938833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.939606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.961653 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 524288 bytes of data to 272574 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.961843 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:47.987123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00008: 89771b482f431367ab05882b853a01a6 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:47.987266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:47.987659 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:47.989889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 18814 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:47.990035 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.016240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00009: 807f8f1c74646a8f9592027f16d2643d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.016762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.016762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.017826 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 21396 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.018000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.040002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00010: 035de9616151b09d26063aaf3786be98 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.040168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.040681 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.055256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 327680 bytes of data to 158643 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.055458 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.082999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00011: f941eba3270410ec15b7aff819b8b0c0 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.083179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.083752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.093109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 327680 bytes of data to 62614 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.093253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.120459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00012: ba683c210943a225502816568e3b8d00 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.120618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.120877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.122699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 14711 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.122814 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.155715 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00013: e88548713f69de90eef0cd6c4e9796dd {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.155929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.156671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.169300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 393216 bytes of data to 90143 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.169485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.199249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00014: 01e3e2d3510c4223690a6849e71496ab {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.199428 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.199693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.205194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 34865 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.205301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.233169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00015: 599805a91aa71f961c3787a61e7c5729 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.233324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.233561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.235252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 7444 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.235391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.258793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00016: 179b961161bdaa477c7c01ad80585eee {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.258967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.259161 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.268554 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 83926 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.268704 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.309199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00017: d27aa048e7ec9b4cbc6afc435ead70f6 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.309450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.310307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.338117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 786432 bytes of data to 349723 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.338298 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.370062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00018: 93a49a74b3f385db27466765f9e213d9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.370279 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.370810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.374305 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 30511 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.374508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.397633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00019: fb0b4c9f443eae7a19740e071a10002c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.397809 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.399502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.486622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 2293760 bytes of data to 749877 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.486770 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.519321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00020: e37f49bc71c3071bbe73b559700da749 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.519481 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.520211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.528227 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 60945 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.528404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.551252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00021: 600a0ec270d9626014f041f394a91dec {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.551402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.551654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.554700 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 21497 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.554833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.578118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00022: d74672ad69032d6511c7f86b7b0cdb23 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.578315 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.578936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.581857 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 16500 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.582103 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.605220 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00023: b26d859ed07de20dd16d0c165a4e6a3a {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.605410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.605871 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.617227 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 294912 bytes of data to 60530 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.617384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.641486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00024: 17812a659c805b2d08ad0ffbac17f523 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.641607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.641818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.644065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 18150 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.644179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.665096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00025: 900ba3be5febaa4a7e8d4fe06a9e5bbe {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.665219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.665382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.666524 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 5224 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.666633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.686066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00026: 7b83ad270600f54dc0ce5f973398f4a1 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.686197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.686350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.687747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 7895 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.687863 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.708020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00027: a31179c9f17d2086e474bbff2d8b9fa5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.708138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.708302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.710977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 16089 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.711085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.734519 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00028: 86d6719d73ca0214c25634aedc7fe9d9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.734642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.734823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.738065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 19002 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.738138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.759947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00029: fdf44fcafc023cb46fe41182b8e073b8 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.760106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.760744 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.779512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 524288 bytes of data to 110895 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.779654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.803560 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00030: 5815c96da9bc9be47f2dde7f69ddd130 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.803682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.803924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.808889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 37108 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.809001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.828813 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00031: 7ecd5b62ea9a77dd27d5058cc0b2af3a {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.828934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.829327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.838059 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 294912 bytes of data to 57886 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.838187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.861796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00032: 185eea5b60ee84638ea2ef67b051e400 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.861898 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.862117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.863504 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 6526 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.863617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.884823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00033: e41a77e44d240ad8104d5fb9712151e4 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.884978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.885168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.887690 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 14907 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.887808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.909823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00034: a7a0eee90ff873fe50f294cf33e7de2d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.909947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.910120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.914320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 32515 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.914493 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.937747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00035: 5a96fd0be63a553958c90d4a4316c4de {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.937880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.938061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.940548 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 13305 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.940658 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.960821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00036: b02b4173598f30151430937bc55a6faf {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.961116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.961507 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.973373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 90046 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.973572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:48.998266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00037: b7e2d07e021e740544325541d67b7329 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:48.998435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:48.998734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:48.999592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 2818 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:48.999738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.021135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00038: 00fb2cc13328ca425a2eca1e6c7c4e6d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.021488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.021488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.022618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 5756 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.022734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.046752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00039: d11036511ad7f5dbe776a742c58f87ea {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.046909 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.047104 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.047796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 1906 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.047941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.070203 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00040: c4ed5bf65e3847ac3a3103aeb9f043f9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.070369 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.070501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.071874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 6858 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.072000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.094127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00041: 2abba25a77ee36c58131400ef11e9b33 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.094275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.094523 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.097776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 15768 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.097869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.119619 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00042: 58c33934aea3dc04d999003f5971d3e1 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.119803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.120076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.123082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 10944 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.123252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.150793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00043: 90971d6560092661366d4a8e0d690316 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.150996 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.151216 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.152479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 5153 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.152660 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.175510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00044: 6d63cabe5cbd45d0e7748b702fb3237f {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.175669 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.176089 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.184045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 229376 bytes of data to 56731 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.184196 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.212626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00045: b63363b73e33269b13a4b9007772caea {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.212761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.448106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.449572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 6383 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.449754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.477375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00046: 7ad27b3399ebe8e17313a1edd45d2a4c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.477561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.477726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.481332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 29648 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.481466 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.504083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00047: b2f4bed0ea8034625ddd32034addd197 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.504182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.504381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.506413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 11536 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.506567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.531151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00048: e2ae44a38272f3786b389fe25de025f7 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.531291 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.531486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.538343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 60908 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.538510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.564964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00049: 459edd959d71fc76632140b2c1c2afd7 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.565111 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.565561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.573518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 49816 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.573651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.599990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00050: 9f03bd9a5f1f3681ce923853068a5391 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.600146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.600440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.601228 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 3271 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.601438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.630618 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00051: 808b8e5ae0ebfa3ebee1f25e56d7380e {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.630740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.632164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.733332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 2162688 bytes of data to 713033 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.733496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.774133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00052: b45628966b6ae6c9d7ffd1b0e2c19000 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.774133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.774433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.784564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 49711 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.784776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.814912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00053: ac2c3b7f365746cfcedfa3644641f133 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.815059 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.817638 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.844978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 109962 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.845088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.872570 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00054: d4e16afa8ee08db846e947df5b4ec08b {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.872718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.873020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.893351 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 106450 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.893351 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.921256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00055: 86d6f3eb5f3f66b3bd977ec8c039a49c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.921435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.921813 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.928653 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 59932 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.928761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.955872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00056: 933534e51561c890b382aa9eb4c5764c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.956040 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.956287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.957633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 9062 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.957785 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:49.979079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00057: 0f7cdc5b89fbb7316ab86f111715879e {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:49.979202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:49.979400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:49.981858 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 23335 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:49.981970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.004333 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00058: b3534e7bd21436d93d6e15ceae51ecbb {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.004484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.004664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.009140 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 36991 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.009287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.029173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00059: 308e5172c7191c405029e68eb339b63e {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.029643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.029643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.033054 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 27296 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.033159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.052881 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00060: 87fed698449bb429c84cea142b47074f {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.052998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.053146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.054136 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 6577 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.054262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.072400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00061: 8577057e39906809834d6bbe62984d84 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.072540 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.074096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.168353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 2162688 bytes of data to 835720 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.168506 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.202077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00062: 286f32389d41ccb3a7454011b7fe833b {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.202222 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.202864 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.207108 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 32835 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.207242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.227870 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00063: 07f83a91f2a65593c97ccde75e2cdb1a {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.228037 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.228224 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.228790 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.228941 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.249942 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00064: 472694eb9fd935b65a675e05db84ae55 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.250114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.250340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.258566 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 163840 bytes of data to 60928 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.258685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.280479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00065: 7bbd91225a7ad728f1ee251495d662a3 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.280636 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.280982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.291252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 89811 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.291412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.316866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00066: 9c2c443a510acae20e828ca784ea0ef0 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.317028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.317335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.318730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 10326 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.318853 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.340583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00067: f15596026d78fb5a6c33e31e645c1bc0 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.340762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.340966 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.344976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 31811 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.345097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.367518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00068: 01e07b6ff49d49600cff2b5f037b5585 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.367671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.367867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.379160 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 99152 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.379277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.406459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00069: 2cc1e5bb8b0f7f6b8f396071b242c82d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.406680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.409153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.515680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 2555904 bytes of data to 1042244 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.515680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.548626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00070: 77a339075c2c22a3b220b8be3eafd00a {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.548781 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.549525 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.559819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 64453 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.559932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.583159 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00071: 4976e1dea54e67ed34a48147acf51f95 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.583431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.583753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.585022 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 7823 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.585132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.605837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00072: c5102cf8b89d0646b4a8454aa2eb455b {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.605982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.606357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.614236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 50703 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.614370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.640614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00073: a90b39452df564cdaee1875cdf14648d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.640867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.641462 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.653165 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 94089 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.653341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.679386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00074: 93190166bf0c7415bc69f707aeecba3d {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.679579 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.680339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.716117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 753664 bytes of data to 382335 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.716260 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.743352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00075: f20b7ef7942c255d34567ef7a8c931d5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.743520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.744796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.828852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 1245184 bytes of data to 692194 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.829047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.858615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00076: 2fec27600c3cba1475524f3a83a147d9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.858760 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.859382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.869308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 229376 bytes of data to 86155 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.869463 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.892707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00077: bd18e2aa13a8966c7ccaeb4a8d2ad111 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.892918 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.893468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.905495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 89989 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.905644 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.928288 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00078: 2742a11d6ef6f40794ba3a77fdd91fc1 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.928438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.929212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.962535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 753664 bytes of data to 244005 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.962735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:50.987831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00079: 937919e06f1ac884e907b3b44f7aa3f7 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:50.987968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:50.988322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:50.989714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 8385 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:50.989827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.010076 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00080: 80bf1a781b69ed6d28f051a8c1bace93 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.010197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.010370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.014560 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 35069 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.014685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.035902 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00081: 839ea305330c068b1e25e10bbe0072eb {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.036169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.036353 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.048361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 101460 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.048541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.072084 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00082: e35f12e70225bea64f1d64820a8c34af {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.072253 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.072527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.073515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 27789 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.073665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.097371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00083: b64ba69a7c7b92cbb6e034a227c535e1 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.097511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.097672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.104456 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 163840 bytes of data to 57870 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.104587 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.129065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00084: 7271b184b3a0862c0307275252dd4c26 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.129182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.129521 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.144881 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 111151 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.145018 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.171973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00085: 534ab1b26cf91adf3fcf3f10f1b565b6 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.172156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.172816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.187019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 524288 bytes of data to 186701 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.187186 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.209769 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00086: 0508f96cd5a0f0ae112aeae2c09703db {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.209908 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.210212 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.211174 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 3526 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.211327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.230935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00087: d6e3280293506ecee8c24358ac5e3fd4 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.231092 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.231192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.231679 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 758 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.231808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.254189 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00088: a7bf7461010858a553631a192d44bf46 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.254352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.254791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.265584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 262144 bytes of data to 93620 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.265819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.290665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00089: a77c3df81950fe3ec6756b32c47d5889 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.290852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.514869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.516727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 14202 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.516861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.537229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00090: c15a2e2eb7fb41df1e140bbf87c78a9c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.537364 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.537581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.549494 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 196608 bytes of data to 99711 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.549606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.572288 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00091: d2f8fd157e57c49a2e7fbb7db668bdfa {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.572469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.572658 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.575581 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 24816 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.575730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.598183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00092: ab4c3c6565d120e31d0ec092b1f40fc0 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.598381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.598599 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.599857 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 9379 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.600008 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.621643 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00093: 6df3fb11329fda670b6a648b803a75c3 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.621772 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.621939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.623596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 11742 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.623699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.646337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00094: d3338725ce0b00d0d0a20c3dc76363b5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.646623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.647489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.672874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 557056 bytes of data to 231400 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.673095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.696933 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00095: 736df86bae8f6a9fbe7631cf877d988c {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.697154 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.697685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.702853 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 45214 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.703049 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.724350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00096: 5465c211d4134a5c770e5e96d9420f8b {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.724512 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.724684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.725620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 3791 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.725733 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.746900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00097: 125fb29df3a88ed91bb536861e7d1ff9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.747072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.747295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.750100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 98304 bytes of data to 26004 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.750219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.773146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00098: 38a20f8b3afb8be4ea4deab5f9b3d080 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.773281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.773476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.778162 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 34863 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.778299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.799479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00099: f87eeae8e3222a88fc335a905cc595f5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.799479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.799479 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.806214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 131072 bytes of data to 28914 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.806455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.830036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00100: a34ec244a0a06a62255379762d3da663 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.830195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.830725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.860873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 393216 bytes of data to 206685 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.861012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.885758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00101: ce40a8df09b1374e7997af78065811c8 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.885894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.886221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.887695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 9850 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.887811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.911228 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00102: 5649b75a126d07b66d0cec64e48b81cf {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.911436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:51.911787 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:51.912614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:51.912759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:51.939948 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00103: 0e20dca488f261121bf31052e9a83f22 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:51.940072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:52.556595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:52.557153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:52.557285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:52.579725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00104: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:52.579841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:52.953020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:52.953726 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 428 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:52.953839 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:52.977562 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00105: d0cc7f773fa003ae73eda5ead2f0e50f {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:52.977682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:53.537714 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:53.538114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:53.538261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:53.562391 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00106: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:53.562693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:53.908786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:53.909538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 427 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:53.909667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:53.931282 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00107: 62d2dec8e103a832fc00a1702fff805a {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:53.931412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:54.464885 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:54.465361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 68 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:54.465497 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:54.491443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00108: 0ac8838eee7696114147d95e0878e3b2 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:54.491577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:55.059003 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:55.059972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 65536 bytes of data to 440 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:55.060097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:55.086717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00109: 1e1457a7affc4e2465169927216ea8a5 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:55.086844 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:55.395624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:41:55.396074 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Compressed 32768 bytes of data to 258 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:41:55.396206 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:41:55.425654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00110: ccd615116dcb4026c3f50f53f219fe04 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:41:55.425778 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:41:55.432303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:41:55.443600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:41:55.443727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:41:55.451515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:41:55.451631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:41:55.455258 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:145}} Jul 03 02:41:55.455495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:41:55.519147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:41:55.520238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:41:55.557987 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "93e8ce89-165c-4fb2-9b17-38be0cfeef1c",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1187429120",\n "created_at": "2026-07-03 02:41:44+00:00",\n "objects": [\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00001": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7455b0146d203e0450dd14035351df50",\n "offset": 0\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00002": {\n "compression": "zlib",\n "length": 294912,\n "md5": "fa9ce028f3d6fc909d3fa99b3a5f338c",\n "offset": 9437184\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00003": {\n "compression": "zlib",\n "length": 2195456,\n "md5": "3cc4787abec81defebbb7b2b01cbac43",\n "offset": 16023552\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00004": {\n "compression": "zlib",\n "length": 98304,\n "md5": "e1554f9208060479cb8c0e2b20ce3092",\n "offset": 20283392\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00005": {\n "compression": "zlib",\n "length": 360448,\n "md5": "260e04b2b4be4a8fb9af5bcaeef77f5e",\n "offset": 20414464\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00006": {\n "compression": "zlib",\n "length": 262144,\n "md5": "7e4882497657c646c554c5ad835c0cf5",\n "offset": 20840448\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00007": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d9cd9a4fb7c178bffad872b9fd1c6616",\n "offset": 21364736\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00008": {\n "compression": "zlib",\n "length": 524288,\n "md5": "89771b482f431367ab05882b853a01a6",\n "offset": 21528576\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00009": {\n "compression": "zlib",\n "length": 98304,\n "md5": "807f8f1c74646a8f9592027f16d2643d",\n "offset": 22085632\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00010": {\n "compression": "zlib",\n "length": 65536,\n "md5": "035de9616151b09d26063aaf3786be98",\n "offset": 22282240\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00011": {\n "compression": "zlib",\n "length": 327680,\n "md5": "f941eba3270410ec15b7aff819b8b0c0",\n "offset": 22478848\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00012": {\n "compression": "zlib",\n "length": 327680,\n "md5": "ba683c210943a225502816568e3b8d00",\n "offset": 22872064\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00013": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e88548713f69de90eef0cd6c4e9796dd",\n "offset": 23265280\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00014": {\n "compression": "zlib",\n "length": 393216,\n "md5": "01e3e2d3510c4223690a6849e71496ab",\n "offset": 23396352\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00015": {\n "compression": "zlib",\n "length": 131072,\n "md5": "599805a91aa71f961c3787a61e7c5729",\n "offset": 23855104\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00016": {\n "compression": "zlib",\n "length": 65536,\n "md5": "179b961161bdaa477c7c01ad80585eee",\n "offset": 24051712\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00017": {\n "compression": "zlib",\n "length": 131072,\n "md5": "d27aa048e7ec9b4cbc6afc435ead70f6",\n "offset": 24510464\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00018": {\n "compression": "zlib",\n "length": 786432,\n "md5": "93a49a74b3f385db27466765f9e213d9",\n "offset": 24707072\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00019": {\n "compression": "zlib",\n "length": 65536,\n "md5": "fb0b4c9f443eae7a19740e071a10002c",\n "offset": 25624576\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00020": {\n "compression": "zlib",\n "length": 2293760,\n "md5": "e37f49bc71c3071bbe73b559700da749",\n "offset": 26214400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00021": {\n "compression": "zlib",\n "length": 262144,\n "md5": "600a0ec270d9626014f041f394a91dec",\n "offset": 28606464\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00022": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d74672ad69032d6511c7f86b7b0cdb23",\n "offset": 29032448\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00023": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b26d859ed07de20dd16d0c165a4e6a3a",\n "offset": 29425664\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00024": {\n "compression": "zlib",\n "length": 294912,\n "md5": "17812a659c805b2d08ad0ffbac17f523",\n "offset": 29622272\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00025": {\n "compression": "zlib",\n "length": 65536,\n "md5": "900ba3be5febaa4a7e8d4fe06a9e5bbe",\n "offset": 30081024\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00026": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7b83ad270600f54dc0ce5f973398f4a1",\n "offset": 30212096\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00027": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a31179c9f17d2086e474bbff2d8b9fa5",\n "offset": 30343168\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00028": {\n "compression": "zlib",\n "length": 98304,\n "md5": "86d6719d73ca0214c25634aedc7fe9d9",\n "offset": 32636928\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00029": {\n "compression": "zlib",\n "length": 98304,\n "md5": "fdf44fcafc023cb46fe41182b8e073b8",\n "offset": 32833536\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00030": {\n "compression": "zlib",\n "length": 524288,\n "md5": "5815c96da9bc9be47f2dde7f69ddd130",\n "offset": 33030144\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00031": {\n "compression": "zlib",\n "length": 131072,\n "md5": "7ecd5b62ea9a77dd27d5058cc0b2af3a",\n "offset": 33619968\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00032": {\n "compression": "zlib",\n "length": 294912,\n "md5": "185eea5b60ee84638ea2ef67b051e400",\n "offset": 33849344\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00033": {\n "compression": "zlib",\n "length": 32768,\n "md5": "e41a77e44d240ad8104d5fb9712151e4",\n "offset": 34275328\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00034": {\n "compression": "zlib",\n "length": 65536,\n "md5": "a7a0eee90ff873fe50f294cf33e7de2d",\n "offset": 34406400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00035": {\n "compression": "zlib",\n "length": 65536,\n "md5": "5a96fd0be63a553958c90d4a4316c4de",\n "offset": 34537472\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00036": {\n "compression": "zlib",\n "length": 98304,\n "md5": "b02b4173598f30151430937bc55a6faf",\n "offset": 38797312\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00037": {\n "compression": "zlib",\n "length": 262144,\n "md5": "b7e2d07e021e740544325541d67b7329",\n "offset": 38928384\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00038": {\n "compression": "zlib",\n "length": 32768,\n "md5": "00fb2cc13328ca425a2eca1e6c7c4e6d",\n "offset": 39256064\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00039": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d11036511ad7f5dbe776a742c58f87ea",\n "offset": 40370176\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00040": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c4ed5bf65e3847ac3a3103aeb9f043f9",\n "offset": 40566784\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00041": {\n "compression": "zlib",\n "length": 32768,\n "md5": "2abba25a77ee36c58131400ef11e9b33",\n "offset": 40697856\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00042": {\n "compression": "zlib",\n "length": 65536,\n "md5": "58c33934aea3dc04d999003f5971d3e1",\n "offset": 40828928\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00043": {\n "compression": "zlib",\n "length": 65536,\n "md5": "90971d6560092661366d4a8e0d690316",\n "offset": 46399488\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00044": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6d63cabe5cbd45d0e7748b702fb3237f",\n "offset": 46596096\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00045": {\n "compression": "zlib",\n "length": 229376,\n "md5": "b63363b73e33269b13a4b9007772caea",\n "offset": 52199424\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00046": {\n "compression": "zlib",\n "length": 32768,\n "md5": "7ad27b3399ebe8e17313a1edd45d2a4c",\n "offset": 52428800\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00047": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b2f4bed0ea8034625ddd32034addd197",\n "offset": 52494336\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00048": {\n "compression": "zlib",\n "length": 65536,\n "md5": "e2ae44a38272f3786b389fe25de025f7",\n "offset": 52592640\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00049": {\n "compression": "zlib",\n "length": 131072,\n "md5": "459edd959d71fc76632140b2c1c2afd7",\n "offset": 52756480\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00050": {\n "compression": "zlib",\n "length": 262144,\n "md5": "9f03bd9a5f1f3681ce923853068a5391",\n "offset": 52953088\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00051": {\n "compression": "zlib",\n "length": 32768,\n "md5": "808b8e5ae0ebfa3ebee1f25e56d7380e",\n "offset": 53280768\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00052": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "b45628966b6ae6c9d7ffd1b0e2c19000",\n "offset": 53411840\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00053": {\n "compression": "zlib",\n "length": 131072,\n "md5": "ac2c3b7f365746cfcedfa3644641f133",\n "offset": 55640064\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00054": {\n "compression": "zlib",\n "length": 262144,\n "md5": "d4e16afa8ee08db846e947df5b4ec08b",\n "offset": 55869440\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00055": {\n "compression": "zlib",\n "length": 196608,\n "md5": "86d6f3eb5f3f66b3bd977ec8c039a49c",\n "offset": 56295424\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00056": {\n "compression": "zlib",\n "length": 196608,\n "md5": "933534e51561c890b382aa9eb4c5764c",\n "offset": 56557568\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00057": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0f7cdc5b89fbb7316ab86f111715879e",\n "offset": 56819712\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00058": {\n "compression": "zlib",\n "length": 65536,\n "md5": "b3534e7bd21436d93d6e15ceae51ecbb",\n "offset": 56950784\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00059": {\n "compression": "zlib",\n "length": 65536,\n "md5": "308e5172c7191c405029e68eb339b63e",\n "offset": 57081856\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00060": {\n "compression": "zlib",\n "length": 98304,\n "md5": "87fed698449bb429c84cea142b47074f",\n "offset": 57212928\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00061": {\n "compression": "zlib",\n "length": 32768,\n "md5": "8577057e39906809834d6bbe62984d84",\n "offset": 57475072\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00062": {\n "compression": "zlib",\n "length": 2162688,\n "md5": "286f32389d41ccb3a7454011b7fe833b",\n "offset": 57606144\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00063": {\n "compression": "zlib",\n "length": 131072,\n "md5": "07f83a91f2a65593c97ccde75e2cdb1a",\n "offset": 59834368\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00064": {\n "compression": "zlib",\n "length": 32768,\n "md5": "472694eb9fd935b65a675e05db84ae55",\n "offset": 60030976\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00065": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7bbd91225a7ad728f1ee251495d662a3",\n "offset": 60227584\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00066": {\n "compression": "zlib",\n "length": 196608,\n "md5": "9c2c443a510acae20e828ca784ea0ef0",\n "offset": 60489728\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00067": {\n "compression": "zlib",\n "length": 32768,\n "md5": "f15596026d78fb5a6c33e31e645c1bc0",\n "offset": 60751872\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00068": {\n "compression": "zlib",\n "length": 131072,\n "md5": "01e07b6ff49d49600cff2b5f037b5585",\n "offset": 60882944\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00069": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2cc1e5bb8b0f7f6b8f396071b242c82d",\n "offset": 61145088\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00070": {\n "compression": "zlib",\n "length": 2555904,\n "md5": "77a339075c2c22a3b220b8be3eafd00a",\n "offset": 61407232\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00071": {\n "compression": "zlib",\n "length": 196608,\n "md5": "4976e1dea54e67ed34a48147acf51f95",\n "offset": 64028672\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00072": {\n "compression": "zlib",\n "length": 32768,\n "md5": "c5102cf8b89d0646b4a8454aa2eb455b",\n "offset": 64290816\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00073": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a90b39452df564cdaee1875cdf14648d",\n "offset": 64356352\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00074": {\n "compression": "zlib",\n "length": 196608,\n "md5": "93190166bf0c7415bc69f707aeecba3d",\n "offset": 64684032\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00075": {\n "compression": "zlib",\n "length": 753664,\n "md5": "f20b7ef7942c255d34567ef7a8c931d5",\n "offset": 64946176\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00076": {\n "compression": "zlib",\n "length": 1245184,\n "md5": "2fec27600c3cba1475524f3a83a147d9",\n "offset": 65863680\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00077": {\n "compression": "zlib",\n "length": 229376,\n "md5": "bd18e2aa13a8966c7ccaeb4a8d2ad111",\n "offset": 67174400\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00078": {\n "compression": "zlib",\n "length": 196608,\n "md5": "2742a11d6ef6f40794ba3a77fdd91fc1",\n "offset": 67567616\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00079": {\n "compression": "zlib",\n "length": 753664,\n "md5": "937919e06f1ac884e907b3b44f7aa3f7",\n "offset": 67829760\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00080": {\n "compression": "zlib",\n "length": 32768,\n "md5": "80bf1a781b69ed6d28f051a8c1bace93",\n "offset": 68681728\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00081": {\n "compression": "zlib",\n "length": 98304,\n "md5": "839ea305330c068b1e25e10bbe0072eb",\n "offset": 68878336\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00082": {\n "compression": "zlib",\n "length": 196608,\n "md5": "e35f12e70225bea64f1d64820a8c34af",\n "offset": 69140480\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00083": {\n "compression": "zlib",\n "length": 32768,\n "md5": "b64ba69a7c7b92cbb6e034a227c535e1",\n "offset": 69402624\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00084": {\n "compression": "zlib",\n "length": 163840,\n "md5": "7271b184b3a0862c0307275252dd4c26",\n "offset": 69468160\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00085": {\n "compression": "zlib",\n "length": 196608,\n "md5": "534ab1b26cf91adf3fcf3f10f1b565b6",\n "offset": 69795840\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00086": {\n "compression": "zlib",\n "length": 524288,\n "md5": "0508f96cd5a0f0ae112aeae2c09703db",\n "offset": 70254592\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00087": {\n "compression": "zlib",\n "length": 98304,\n "md5": "d6e3280293506ecee8c24358ac5e3fd4",\n "offset": 71041024\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00088": {\n "compression": "zlib",\n "length": 32768,\n "md5": "a7bf7461010858a553631a192d44bf46",\n "offset": 71172096\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00089": {\n "compression": "zlib",\n "length": 262144,\n "md5": "a77c3df81950fe3ec6756b32c47d5889",\n "offset": 72417280\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00090": {\n "compression": "zlib",\n "length": 65536,\n "md5": "c15a2e2eb7fb41df1e140bbf87c78a9c",\n "offset": 110100480\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00091": {\n "compression": "zlib",\n "length": 196608,\n "md5": "d2f8fd157e57c49a2e7fbb7db668bdfa",\n "offset": 110297088\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00092": {\n "compression": "zlib",\n "length": 65536,\n "md5": "ab4c3c6565d120e31d0ec092b1f40fc0",\n "offset": 110559232\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00093": {\n "compression": "zlib",\n "length": 32768,\n "md5": "6df3fb11329fda670b6a648b803a75c3",\n "offset": 110690304\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00094": {\n "compression": "zlib",\n "length": 32768,\n "md5": "d3338725ce0b00d0d0a20c3dc76363b5",\n "offset": 110821376\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00095": {\n "compression": "zlib",\n "length": 557056,\n "md5": "736df86bae8f6a9fbe7631cf877d988c",\n "offset": 110952448\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00096": {\n "compression": "zlib",\n "length": 131072,\n "md5": "5465c211d4134a5c770e5e96d9420f8b",\n "offset": 111607808\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00097": {\n "compression": "zlib",\n "length": 32768,\n "md5": "125fb29df3a88ed91bb536861e7d1ff9",\n "offset": 111869952\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00098": {\n "compression": "zlib",\n "length": 98304,\n "md5": "38a20f8b3afb8be4ea4deab5f9b3d080",\n "offset": 112001024\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00099": {\n "compression": "zlib",\n "length": 131072,\n "md5": "f87eeae8e3222a88fc335a905cc595f5",\n "offset": 112197632\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00100": {\n "compression": "zlib",\n "length": 131072,\n "md5": "a34ec244a0a06a62255379762d3da663",\n "offset": 112590848\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00101": {\n "compression": "zlib",\n "length": 393216,\n "md5": "ce40a8df09b1374e7997af78065811c8",\n "offset": 113770496\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00102": {\n "compression": "zlib",\n "length": 32768,\n "md5": "5649b75a126d07b66d0cec64e48b81cf",\n "offset": 114229248\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00103": {\n "compression": "zlib",\n "length": 65536,\n "md5": "0e20dca488f261121bf31052e9a83f22",\n "offset": 143654912\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00104": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 277872640\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00105": {\n "compression": "zlib",\n "length": 65536,\n "md5": "d0cc7f773fa003ae73eda5ead2f0e50f",\n "offset": 412090368\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00106": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 546308096\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00107": {\n "compression": "zlib",\n "length": 65536,\n "md5": "62d2dec8e103a832fc00a1702fff805a",\n "offset": 680525824\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00108": {\n "compression": "zlib",\n "length": 32768,\n "md5": "0ac8838eee7696114147d95e0878e3b2",\n "offset": 814743552\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00109": {\n "compression": "zlib",\n "length": 65536,\n "md5": "1e1457a7affc4e2465169927216ea8a5",\n "offset": 948961280\n }\n },\n {\n "volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00110": {\n "compression": "zlib",\n "length": 32768,\n "md5": "ccd615116dcb4026c3f50f53f219fe04",\n "offset": 1073709056\n }\n }\n ],\n "parent_id": "58eac833-bfed-42fd-94f0-f7e118111aa0",\n "version": "1.0.0",\n "volume_id": "3911af54-12a2-48da-8a87-0d473084b7c9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"3911af54-12a2-48da-8a87-0d473084b7c9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:40:22.000000\\", \\"launched_at\\": \\"2026-07-03T02:40:23.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-831849675\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": true, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:40:22.000000\\", \\"updated_at\\": \\"2026-07-03T02:41:44.000000\\"}, \\"volume-glance-metadata\\": {\\"hw_rng_model\\": \\"virtio\\", \\"os_glance_failed_import\\": \\"\\", \\"os_glance_importing_to_stores\\": \\"\\", \\"owner_specified.openstack.md5\\": \\"\\", \\"owner_specified.openstack.object\\": \\"images/cirros-0.6.3-x86_64-disk\\", \\"owner_specified.openstack.sha256\\": \\"\\", \\"image_id\\": \\"ea993fc3-c724-45f7-8dae-63cf2cac16e5\\", \\"image_name\\": \\"cirros-0.6.3-x86_64-disk\\", \\"checksum\\": \\"87617e24a5e30cb3b87fda8c0764838f\\", \\"container_format\\": \\"bare\\", \\"disk_format\\": \\"qcow2\\", \\"min_disk\\": \\"0\\", \\"min_ram\\": \\"0\\", \\"size\\": \\"21692416\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:41:55.564131 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] backup 93e8ce89-165c-4fb2-9b17-38be0cfeef1c finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:41:55.565999 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:41:55.583266 np0000004352 sudo[160615]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:41:55.583905 np0000004352 sudo[160615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:41:55.888969 np0000004352 sudo[160615]: pam_unix(sudo:session): session closed for user root Jul 03 02:41:55.891297 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.325s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:41:55.892197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000a0c13f6d', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:41:55.892364 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:41:55.893033 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:41:55.893521 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3911af54-12a2-48da-8a87-0d473084b7c9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:41:55.905075 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:41:55.906027 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:41:55.906027 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:41:55.906027 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:41:55.906027 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:41:55.931616 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [228] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9 (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:41:55.932018 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:41:55.932298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498', '230')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:41:55.932298 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9', '228')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:41:55.933615 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a86ade0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:41:55.933895 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Removing multipathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:41:55.934229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Flush multipath device 330000000a0c13f6d {{(pid=101397) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jul 03 02:41:56.122345 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:41:56.130528 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:41:56.179950 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:41:56.180137 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:41:56.181826 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:41:56.191922 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:41:56.192135 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:41:56.202964 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:56.232372 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] Jul 03 02:41:56.232372 np0000004352 cinder-backup[101397]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-3911af54-12a2-48da-8a87-0d473084b7c9, portal: 192.168.40.100,3260] successful. Jul 03 02:41:56.232372 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:56.247229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:41:56.247556 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:41:56.247758 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (355ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:41:57.278831 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-135ea162-1309-4b15-853d-40283e1ad23d tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: 93e8ce89-165c-4fb2-9b17-38be0cfeef1c. Jul 03 02:41:57.568764 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: 93e8ce89-165c-4fb2-9b17-38be0cfeef1c. Jul 03 02:41:57.573988 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:41:57.574201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:41:57.574373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] delete started, backup: 93e8ce89-165c-4fb2-9b17-38be0cfeef1c, container: volumebackups, prefix: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:41:57.633662 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00001', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00002', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00003', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00004', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00005', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00006', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00007', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00008', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00009', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00010', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00011', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00012', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00013', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00014', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00015', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00016', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00017', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00018', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00019', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00020', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00021', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00022', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00023', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00024', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00025', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00026', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00027', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00028', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00029', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00030', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00031', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00032', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00033', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00034', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00035', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00036', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00037', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00038', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00039', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00040', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00041', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00042', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00043', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00044', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00045', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00046', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00047', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00048', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00049', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00050', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00051', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00052', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00053', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00054', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00055', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00056', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00057', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00058', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00059', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00060', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00061', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00062', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00063', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00064', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00065', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00066', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00067', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00068', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00069', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00070', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00071', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00072', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00073', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00074', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00075', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00076', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00077', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00078', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00079', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00080', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00081', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00082', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00083', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00084', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00085', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00086', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00087', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00088', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00089', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00090', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00091', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00092', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00093', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00094', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00095', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00096', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00097', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00098', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00099', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00100', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00101', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00102', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00103', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00104', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00105', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00106', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00107', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00108', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00109', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00110', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_metadata', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:41:57.655075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.674809 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.693840 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.713758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.731298 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.754026 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.775796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.795859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.814442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.839034 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.860789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.883233 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.906701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.931867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.952682 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.974250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:57.997621 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.027625 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.047213 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.067258 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.090547 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.110513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00022 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.130132 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00023 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.151459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00024 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.177484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00025 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.207069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00026 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.229838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00027 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.259096 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00028 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.284518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00029 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.316984 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00030 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.343759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00031 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.366412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00032 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.387360 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00033 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.409748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00034 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.429249 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00035 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.457789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00036 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.481436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00037 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.505158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00038 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.533767 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00039 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.558703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00040 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.580874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00041 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.605669 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00042 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.631145 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00043 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.649631 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00044 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.672372 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00045 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.692550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00046 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.712176 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00047 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.731746 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00048 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.750573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00049 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.769064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00050 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.790024 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00051 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.811656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00052 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.832740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00053 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.854732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00054 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.873176 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00055 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.892267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00056 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.908384 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00057 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.925088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00058 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.945666 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00059 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.966483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00060 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:58.989197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00061 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.009188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00062 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.029954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00063 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.050048 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00064 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.068557 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00065 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.087020 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00066 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.107578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00067 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.127873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00068 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.163082 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00069 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.184811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00070 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.206042 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00071 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.233706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00072 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.254799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00073 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.281286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00074 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.307301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00075 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.334981 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00076 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.370620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00077 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.400780 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00078 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.435413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00079 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.454413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00080 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.475033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00081 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.494256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00082 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.514356 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00083 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.535489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00084 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.554322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00085 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.573924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00086 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.601124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00087 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.623609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00088 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.645358 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00089 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.664921 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00090 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.687650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00091 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.712708 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00092 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.731102 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00093 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.749426 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00094 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.767206 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00095 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.785859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00096 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.805200 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00097 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.821819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00098 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.839186 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00099 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.856731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00100 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.882331 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00101 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.904281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00102 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.922740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00103 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.941392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00104 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.958623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00105 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:41:59.976742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00106 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.002039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00107 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.022592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00108 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.041539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00109 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.059038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c-00110 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.075592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.093292 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024147/az_nova_backup_93e8ce89-165c-4fb2-9b17-38be0cfeef1c_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:00.093482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] delete 93e8ce89-165c-4fb2-9b17-38be0cfeef1c finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:42:00.123849 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:00.137102 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] Created reservations ['ab002937-e57c-4c21-84df-a58d27aad71b', '80f24ef1-2a96-4729-a222-1c9cf71f593c'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:42:00.165246 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-7a9bc3da-5fa9-4ccc-a4fb-94ddd0f24b85 tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup 93e8ce89-165c-4fb2-9b17-38be0cfeef1c deleted. Jul 03 02:42:01.188550 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: 58eac833-bfed-42fd-94f0-f7e118111aa0. Jul 03 02:42:01.190686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:42:01.191004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:42:01.191283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] delete started, backup: 58eac833-bfed-42fd-94f0-f7e118111aa0, container: volumebackups, prefix: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:42:01.255032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00001', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00002', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00003', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00004', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00005', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00006', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00007', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00008', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00009', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00010', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00011', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00012', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00013', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00014', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00015', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00016', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00017', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00018', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00019', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00020', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00021', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_metadata', 'volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:42:01.274749 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.289635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.306202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.321971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.340050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.357439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.374946 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.394813 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.413262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.431983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.448622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.466158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.483375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.499708 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.522692 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.543246 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.562572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.580173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.601386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.621585 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.642469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.664199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.681889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_3911af54-12a2-48da-8a87-0d473084b7c9/20260703024026/az_nova_backup_58eac833-bfed-42fd-94f0-f7e118111aa0_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:01.682084 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] delete 58eac833-bfed-42fd-94f0-f7e118111aa0 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:42:01.721270 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:01.735059 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] Created reservations ['c810a9da-d565-4007-81f1-3c67a47fd406', '1642e5a1-be66-463d-9ba3-246969e7900b'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:42:01.752730 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-1a879b63-0520-4cc1-858d-400cd97776c2 tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup 58eac833-bfed-42fd-94f0-f7e118111aa0 deleted. Jul 03 02:42:03.078509 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:42:03.078509 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:42:04.739569 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Create backup started, backup: 60202367-7895-46d9-9e7c-968880eb4cd0 volume: 521e14d7-77ed-4879-afde-712100617c82 snapshot: 6f48ac0e-cab1-4e27-874e-f39e58dc53cc. Jul 03 02:42:04.745106 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:42:04Z,data_timestamp=2026-07-03T02:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-725841078',encryption_key_id=None,fail_reason=None,host='np0000004352',id=60202367-7895-46d9-9e7c-968880eb4cd0,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='5b2cdb72840643d690a329de32482c4b',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id='6f48ac0e-cab1-4e27-874e-f39e58dc53cc',status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='106d3bc2bae34ea2bcada267bec638ad',volume_id=521e14d7-77ed-4879-afde-712100617c82) Jul 03 02:42:04.805810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:42:04.806023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:42:04.806326 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:04.816408 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:42:04.838716 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:04.851524 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:42:04.851524 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:42:04.860476 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:42:04.861958 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe62:f9b8', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe6b:f9f2', 'fe80::18f9:89ff:fe93:18da', 'fe80::b0e7:d1ff:fe4b:d598', 'fe80::fc16:3eff:fee6:92c2'] Jul 03 02:42:04.861958 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:42:04.862208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:42:04.862473 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] <== get_connector_properties: return (55ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:05.366551 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:42:05.366977 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:05.367241 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:05.367918 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:05.368240 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:42:05.380642 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:05.381150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:05.381415 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:42:05.392957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:42:05.392957 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e] added Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:42:05.406947 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:05.407312 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:42:05.407956 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:42:05.408260 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:42:06.409558 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:42:06.424671 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:06.440608 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.456609 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.456869 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:06.505011 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e, portal: 192.168.40.100,3260] Jul 03 02:42:06.505011 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e, portal: 192.168.40.100,3260] successful. Jul 03 02:42:06.505011 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:06.518048 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e (non-flash) Jul 03 02:42:06.537341 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-639af660-aa0b-4db2-8047-508f531287fd (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e (non-flash) Jul 03 02:42:06.537744 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:06.541217 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:06.541217 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:42:06.541217 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] HCTL ('15', '-', '-', 0) found on session 233 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:42:06.541217 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Scanning host 15 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:42:06.556834 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Searching for a device in session 233 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:42:06.557082 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:42:07.562977 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.195s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:07.563404 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] <== connect_volume: return (2196ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799244', 'path': '/dev/sdj'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:07.563559 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:07.583711 np0000004352 sudo[161045]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj Jul 03 02:42:07.584456 np0000004352 sudo[161045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:42:07.889209 np0000004352 sudo[161045]: pam_unix(sudo:session): session closed for user root Jul 03 02:42:07.891981 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdj" returned: 0 in 0.328s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:42:07.945588 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:07.952985 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _create_container started, container: volumebackups,backup: 60202367-7895-46d9-9e7c-968880eb4cd0. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:42:07.987934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] generate_object_name_prefix: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:42:07.993995 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] starting backup of volume: 521e14d7-77ed-4879-afde-712100617c82, volume size: 1073741824, object names prefix volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:42:08.177568 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:08.461847 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:08.461976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:08.565434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:08.565877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:08.745683 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:08.996778 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:08.996957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:09.101113 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:09.101263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:09.326330 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:09.569393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:09.569935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:09.675062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:09.675373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:09.886437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:10.138352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:10.138635 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:10.244891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:10.245208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:10.437667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:10.710793 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:10.711367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:10.813042 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:10.813293 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:11.008304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:11.264240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:11.264755 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:11.372157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:11.372352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:11.562709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:11.820594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:11.821027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:11.929956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:11.930109 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:12.147256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:12.410520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:12.410680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:12.519367 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:12.519564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:12.745987 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:13.005252 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:13.005717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:13.106436 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:13.106647 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:13.410001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:13.674152 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:13.674288 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:13.798055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:13.798312 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:14.009674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:14.260782 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:14.260929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:14.368646 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:14.368834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:14.561877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:14.811488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:14.811641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:14.916516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:14.916516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:15.136967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:15.392761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:15.392761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:15.494572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:15.494572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:15.702774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:15.946246 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:15.946438 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:16.054443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:16.054727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:16.264699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:16.521085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:16.521231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:16.626691 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:16.626874 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:16.804816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:17.046837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:17.047004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:17.152946 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:17.153119 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:17.355250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:17.630899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:17.631027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:17.735469 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:17.735686 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:17.928668 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:18.188501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:18.188719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:18.291095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:18.291276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:18.511517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:18.756624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:18.756807 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:18.856784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:18.856969 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:19.056362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:19.307097 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:19.307240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:19.411773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:19.411929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:19.497167 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:19.618500 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:19.618910 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:19.681141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup MD5 for volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:19.681344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:19.688302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:42:19.694087 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:42:19.694283 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:42:19.698393 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:42:19.698568 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:42:19.701775 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:42:19.702362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:42:19.753812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:42:19.754547 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _write_metadata started, container name: volumebackups, metadata filename: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:42:19.798445 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "60202367-7895-46d9-9e7c-968880eb4cd0",\n "backup_name": "tempest-VolumesBackupsTest-Backup-725841078",\n "created_at": "2026-07-03 02:42:05+00:00",\n "objects": [\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "521e14d7-77ed-4879-afde-712100617c82",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"521e14d7-77ed-4879-afde-712100617c82\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"106d3bc2bae34ea2bcada267bec638ad\\", \\"project_id\\": \\"5b2cdb72840643d690a329de32482c4b\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"available\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:42:02.000000\\", \\"launched_at\\": \\"2026-07-03T02:42:03.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-439390036\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": null, \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:42:02.000000\\", \\"updated_at\\": \\"2026-07-03T02:42:03.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:42:19.807443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] backup 60202367-7895-46d9-9e7c-968880eb4cd0 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:42:19.934875 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:19.955545 np0000004352 sudo[161187]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj Jul 03 02:42:19.956411 np0000004352 sudo[161187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:42:20.292265 np0000004352 sudo[161187]: pam_unix(sudo:session): session closed for user root Jul 03 02:42:20.295096 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdj" returned: 0 in 0.360s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:42:20.295975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799244', 'path': '/dev/sdj'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:20.296377 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:20.298181 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:20.298845 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '285cb11f-61b0-4ad7-9133-cd4e4baf517e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.50.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:20.312830 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:20.313906 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:42:20.313906 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:42:20.313906 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:42:20.314202 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e (non-flash) Jul 03 02:42:20.341073 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498 (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e (non-flash) Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:20.341465 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9', '227'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9af9492f-fb06-4ea7-a83f-fa476d4f8498', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', '233')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:42:20.341748 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e', '233')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:42:20.342560 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Resulting device map defaultdict(. at 0x78357a869300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e'): ({'sdj'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:42:20.342764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Removing single pathed devices sdj {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:42:20.354271 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Flushing IO for device /dev/sdj {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:42:20.363687 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:42:20.417066 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Checking to see if SCSI volumes sdj have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:42:20.417238 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] SCSI volumes sdj have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:42:20.418679 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Checking to see if device paths {'sdj'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:42:20.432412 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Device paths {'sdj'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:42:20.432760 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:42:20.444957 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:20.484454 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 233, target: iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e, portal: 192.168.40.100,3260] Jul 03 02:42:20.484454 np0000004352 cinder-backup[101397]: Logout of [sid: 233, target: iqn.2023-03.storpool.com:os--volume-285cb11f-61b0-4ad7-9133-cd4e4baf517e, portal: 192.168.40.100,3260] successful. Jul 03 02:42:20.484454 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:20.504669 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:20.504987 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.207s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:20.505146 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] <== disconnect_volume: return (209ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:21.544480 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-fbeceafb-b47b-43dd-9c53-72d70169932c tempest-VolumesBackupsTest-1892682639 None] Create backup finished. backup: 60202367-7895-46d9-9e7c-968880eb4cd0. Jul 03 02:42:22.185079 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] Delete backup started, backup: 60202367-7895-46d9-9e7c-968880eb4cd0. Jul 03 02:42:22.188853 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_5b2cdb72840643d690a329de32482c4b {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:42:22.189072 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:42:22.189256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] delete started, backup: 60202367-7895-46d9-9e7c-968880eb4cd0, container: volumebackups, prefix: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:42:22.241069 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] generated object list: ['volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00001', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00002', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00003', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00004', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00005', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00006', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00007', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00008', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00009', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00010', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00011', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00012', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00013', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00014', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00015', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00016', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00017', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00018', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00019', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00020', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00021', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_metadata', 'volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:42:22.268983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.291940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.314286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.339236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.360904 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.383004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.402732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.425634 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.447275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.476157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.517027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.555914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.583019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.606759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.631011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.652340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.671488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.697652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.724039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.750232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.770053 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.791888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.822555 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] deleted object: volume_521e14d7-77ed-4879-afde-712100617c82/20260703024207/az_nova_backup_60202367-7895-46d9-9e7c-968880eb4cd0_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:22.822739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] delete 60202367-7895-46d9-9e7c-968880eb4cd0 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:42:22.854579 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:22.868324 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] Created reservations ['f37fecb5-247a-4b91-9808-01cd03c9971f', '17d1436a-fd80-47fa-b852-1a64d2ce2e7e'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:42:22.897509 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-93c1d446-cf13-45a8-be3b-bb4376f42728 tempest-VolumesBackupsTest-1892682639 None] Delete backup finished, backup 60202367-7895-46d9-9e7c-968880eb4cd0 deleted. Jul 03 02:42:32.893276 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=89,cinder:UPDATE=33,cinder:INSERT=6 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:42:41.706439 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Create backup started, backup: ce04d1b6-b05a-41b4-b3e8-8186638c2a73 volume: 5b489957-6347-4c04-8662-ca80719ca3af. Jul 03 02:42:41.711363 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:42:41Z,data_timestamp=2026-07-03T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-1812281408',encryption_key_id=None,fail_reason=None,host='np0000004352',id=ce04d1b6-b05a-41b4-b3e8-8186638c2a73,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='7cf259b5b8784c1d8da77365c00860d6',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='30685639b618496eaafa803871f9781b',volume_id=5b489957-6347-4c04-8662-ca80719ca3af) Jul 03 02:42:41.733470 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7cf259b5b8784c1d8da77365c00860d6 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:42:41.733652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:42:41.733887 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:41.745055 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:42:41.764964 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:41.776093 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:42:41.776353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:42:41.784579 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:42:41.785560 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447', 'fe80::fc16:3eff:fe62:f9b8', 'fe80::70ce:aeff:fe58:123b', 'fe80::fc16:3eff:fe6f:1e21', 'fe80::b0e7:d1ff:fe4b:d598'] Jul 03 02:42:41.785726 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:42:41.785847 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:42:41.786084 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:42.290246 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:42:42.290647 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b489957-6347-4c04-8662-ca80719ca3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:42.290801 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:42.291251 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:42.291490 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b489957-6347-4c04-8662-ca80719ca3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:42:42.303828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:42.304253 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:42.304508 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:42:42.315754 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:42:42.315754 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af] added Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:42:42.328315 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:42.328751 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:42:42.329073 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:42:42.329342 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:42:43.331303 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:42:43.343629 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:43.356605 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:43.371561 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.371561 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.371561 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.371561 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.371561 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:43.371919 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.371919 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.371919 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.371919 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.371919 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:43.408341 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af, portal: 192.168.40.100,3260] Jul 03 02:42:43.408341 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af, portal: 192.168.40.100,3260] successful. Jul 03 02:42:43.408341 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:43.419529 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('-m', 'session'): stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af (non-flash) Jul 03 02:42:43.435008 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsi session list stdout=tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1acf83d0-5e05-44e1-be4f-eb5fe04a95ad (non-flash) Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-776dc51f-623b-4596-9af3-7d4869eeb3f9 (non-flash) Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af (non-flash) Jul 03 02:42:43.435260 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:43.435506 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:43.435655 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:42:43.436353 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] HCTL ('7', '-', '-', 0) found on session 234 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:42:43.436487 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:42:43.448956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Searching for a device in session 234 and hctl ['7', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:42:44.450146 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Searching for a device in session 234 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:42:44.450750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b489957-6347-4c04-8662-ca80719ca3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:42:44.450995 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.160s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:44.451183 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] <== connect_volume: return (2160ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799248', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:44.451504 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:44.466698 np0000004352 sudo[161423]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:42:44.467455 np0000004352 sudo[161423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:42:44.772992 np0000004352 sudo[161423]: pam_unix(sudo:session): session closed for user root Jul 03 02:42:44.775479 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.323s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:42:44.828601 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:44.834680 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _create_container started, container: volumebackups,backup: ce04d1b6-b05a-41b4-b3e8-8186638c2a73. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:42:45.020498 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] generate_object_name_prefix: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:42:45.029217 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] starting backup of volume: 5b489957-6347-4c04-8662-ca80719ca3af, volume size: 1073741824, object names prefix volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:42:45.229624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:45.482195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:45.482195 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:45.599538 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:45.599740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:45.805990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:46.069617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:46.069908 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:46.172607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:46.172774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:46.375355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:46.616048 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:46.616466 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:46.716717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:46.716925 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:46.921556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:47.159795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:47.159952 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:47.271311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:47.271580 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:47.481117 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:48.348550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:48.348550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:48.348550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:48.348550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:48.348550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:48.370229 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:48.370364 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:48.475141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:48.475307 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:48.669168 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:48.921295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:48.921558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:49.025442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:49.025757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:49.225221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:49.474715 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:49.475144 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:49.574238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:49.574495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:49.766513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:50.022287 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:50.022433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:50.123326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:50.123482 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:50.323721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:50.569728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:50.570310 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:50.677304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:50.677599 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:50.877970 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:51.134894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:51.135079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:51.237992 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:51.238110 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:51.450573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:51.706865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:51.707491 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:51.814173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:51.814323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:52.026602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:52.284861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:52.285014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:52.389604 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:52.389776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:52.580608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:52.836590 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:52.837118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:52.944434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:52.944771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:53.150597 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:53.399357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:53.399550 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:53.506882 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:53.507127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:53.761330 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:54.021272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:54.021675 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:54.121577 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:54.121758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:54.329441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:54.583752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:54.583896 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:54.688224 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:54.688567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:54.912926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:55.160329 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:55.160999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:55.265116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:55.265300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:55.492873 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:55.735241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:55.735371 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:55.844446 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:55.844633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:56.024712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:56.289080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:56.289518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:56.395081 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:56.395320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:56.522697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:42:56.646901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:42:56.646901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:42:56.711439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup MD5 for volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:42:56.711773 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:42:56.721499 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:42:56.729654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:42:56.729915 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:42:56.735199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:42:56.735472 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:42:56.739642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:42:56.740011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:42:56.801584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:42:56.802542 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _write_metadata started, container name: volumebackups, metadata filename: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:42:56.832919 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "ce04d1b6-b05a-41b4-b3e8-8186638c2a73",\n "backup_name": "tempest-type-Backup-1812281408",\n "created_at": "2026-07-03 02:42:42+00:00",\n "objects": [\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "5b489957-6347-4c04-8662-ca80719ca3af",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"5b489957-6347-4c04-8662-ca80719ca3af\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"30685639b618496eaafa803871f9781b\\", \\"project_id\\": \\"7cf259b5b8784c1d8da77365c00860d6\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:42:41.000000\\", \\"launched_at\\": \\"2026-07-03T02:42:41.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-1048019418\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:42:40.000000\\", \\"updated_at\\": \\"2026-07-03T02:42:42.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:42:56.839221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] backup ce04d1b6-b05a-41b4-b3e8-8186638c2a73 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:42:56.974397 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:42:56.997620 np0000004352 sudo[161621]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:42:56.998506 np0000004352 sudo[161621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:42:57.388714 np0000004352 sudo[161621]: pam_unix(sudo:session): session closed for user root Jul 03 02:42:57.391043 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.416s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:42:57.391924 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b489957-6347-4c04-8662-ca80719ca3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799248', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:42:57.392177 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:42:57.392845 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:42:57.393365 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5b489957-6347-4c04-8662-ca80719ca3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:42:57.405620 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:57.406029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:42:57.406029 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:42:57.406029 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:42:57.406120 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:42:57.432513 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('-m', 'session'): stdout=tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af (non-flash) Jul 03 02:42:57.432513 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:42:57.433021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsi session list stdout=tcp: [234] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af (non-flash) Jul 03 02:42:57.433021 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:42:57.433021 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', '234')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:42:57.433147 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af', '234')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:42:57.434253 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Resulting device map defaultdict(. at 0x78357a4ef100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:42:57.434545 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:42:57.446359 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:42:57.455574 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:42:57.500225 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:42:57.500484 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:42:57.501396 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:42:57.515252 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:42:57.515636 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:42:57.528185 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:57.555471 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af, portal: 192.168.40.100,3260] Jul 03 02:42:57.555471 np0000004352 cinder-backup[101397]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-5b489957-6347-4c04-8662-ca80719ca3af, portal: 192.168.40.100,3260] successful. Jul 03 02:42:57.555471 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:57.566083 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:42:57.566433 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.174s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:42:57.566649 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] <== disconnect_volume: return (174ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:42:58.603357 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-89c13465-baa7-4ad0-9c67-5214d9d62242 tempest-ProjectAdminTests39-2129617129 None] Create backup finished. backup: ce04d1b6-b05a-41b4-b3e8-8186638c2a73. Jul 03 02:42:59.210997 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] Delete backup started, backup: ce04d1b6-b05a-41b4-b3e8-8186638c2a73. Jul 03 02:42:59.214666 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_7cf259b5b8784c1d8da77365c00860d6 {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:42:59.214806 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:42:59.215146 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] delete started, backup: ce04d1b6-b05a-41b4-b3e8-8186638c2a73, container: volumebackups, prefix: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:42:59.269291 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] generated object list: ['volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00001', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00002', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00003', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00004', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00005', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00006', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00007', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00008', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00009', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00010', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00011', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00012', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00013', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00014', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00015', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00016', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00017', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00018', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00019', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00020', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00021', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_metadata', 'volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:42:59.296454 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.322798 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.348587 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.377881 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.402803 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.429575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.451973 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.476219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.499357 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.522734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.548106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.573017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.593747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.617164 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.639047 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.660308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.681609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.703819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.725641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.748392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.770766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.796924 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.825093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] deleted object: volume_5b489957-6347-4c04-8662-ca80719ca3af/20260703024245/az_nova_backup_ce04d1b6-b05a-41b4-b3e8-8186638c2a73_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:42:59.825937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] delete ce04d1b6-b05a-41b4-b3e8-8186638c2a73 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:42:59.860169 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:42:59.881235 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] Created reservations ['13af34aa-5d59-4a9f-b889-16412220bc85', '39574e7c-f66c-4bcd-a97d-d0e2972dd391'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:42:59.904205 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-3ebedb78-6092-48c4-bd3e-cf6b4b0bf8da tempest-ProjectAdminTests39-2129617129 None] Delete backup finished, backup ce04d1b6-b05a-41b4-b3e8-8186638c2a73 deleted. Jul 03 02:43:02.159454 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Create backup started, backup: 39cddc42-5bb7-4d65-998a-b894b63a307e volume: 459ac9a2-9f55-411d-bcf0-f5c442af8a67. Jul 03 02:43:02.168717 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:43:02Z,data_timestamp=2026-07-03T02:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromBackupTest-Backup-880735868',encryption_key_id=None,fail_reason=None,host='np0000004352',id=39cddc42-5bb7-4d65-998a-b894b63a307e,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c9b37d0745fb4ee88f524a89b655e0ee',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='daac2840f6df46e3893010406bf9633e',volume_id=459ac9a2-9f55-411d-bcf0-f5c442af8a67) Jul 03 02:43:02.198854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_c9b37d0745fb4ee88f524a89b655e0ee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:02.198854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:02.199411 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:02.216175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:43:02.242726 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:02.255453 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:43:02.255805 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:43:02.265347 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:43:02.266518 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:43:02.267015 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:43:02.267015 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:43:02.267567 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:02.772311 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:43:02.772859 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:02.773123 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:02.773780 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:02.774104 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:43:02.787759 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:02.788262 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:02.788557 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:02.800381 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:43:02.800381 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67] added Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:02.811981 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:02.812256 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:43:02.812702 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:43:02.812926 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:43:03.081691 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:43:03.081867 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:43:03.814613 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:43:03.832715 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:03.847944 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:43:03.859095 np0000004352 cinder-backup[101397]: Jul 03 02:43:03.949977 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67, portal: 192.168.40.100,3260] Jul 03 02:43:03.949977 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67, portal: 192.168.40.100,3260] successful. Jul 03 02:43:03.949977 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:03.961465 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:03.973935 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('-m', 'session'): stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:03.973935 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:03.974151 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsi session list stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:03.974151 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:03.975029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:03.975029 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:43:03.975770 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] HCTL ('7', '-', '-', 0) found on session 235 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:43:03.975770 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:43:03.991761 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Searching for a device in session 235 and hctl ['7', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:04.991576 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Searching for a device in session 235 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:04.992046 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:43:04.992592 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.219s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:04.992793 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] <== connect_volume: return (2220ms) {'type': 'block', 'scsi_wwn': '33000000021f05848', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:04.993204 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:05.011003 np0000004352 sudo[161731]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:43:05.011707 np0000004352 sudo[161731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:05.440785 np0000004352 sudo[161731]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:05.443084 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.449s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:05.485848 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:05.492262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _create_container started, container: volumebackups,backup: 39cddc42-5bb7-4d65-998a-b894b63a307e. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:43:05.719065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] generate_object_name_prefix: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:43:05.727658 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] starting backup of volume: 459ac9a2-9f55-411d-bcf0-f5c442af8a67, volume size: 1073741824, object names prefix volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:43:05.981905 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:06.241349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:06.241818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:06.360539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:06.360725 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:06.595503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:06.853998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:06.854175 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:06.956598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:06.956739 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:07.146124 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:07.404841 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:07.405443 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:07.512845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:07.513045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:07.762751 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:07.901333 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Create backup started, backup: 7f9c8e49-f008-4234-8aea-fec792155ebe volume: f197a4e5-8e70-436b-a3e9-1893bd21379a. Jul 03 02:43:07.909299 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:43:07Z,data_timestamp=2026-07-03T02:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-323404149',encryption_key_id=None,fail_reason=None,host='np0000004352',id=7f9c8e49-f008-4234-8aea-fec792155ebe,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1c90cac2fc954e8f9955fb497cbecdee',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8944104afe174b6fb7371bffc9897515',volume_id=f197a4e5-8e70-436b-a3e9-1893bd21379a) Jul 03 02:43:07.953766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:07.953983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:07.954537 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:07.972106 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:43:08.005407 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:08.023116 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:43:08.023392 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:43:08.032518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:08.032759 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:08.033963 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:43:08.034985 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:43:08.035135 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:43:08.035275 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:43:08.035579 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:08.147929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:08.148166 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:08.199137 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:08.400508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:08.542670 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:43:08.543201 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f197a4e5-8e70-436b-a3e9-1893bd21379a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:08.543391 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:08.544013 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:08.544327 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f197a4e5-8e70-436b-a3e9-1893bd21379a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:43:08.557724 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:08.558149 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:08.558380 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:08.569254 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:43:08.569254 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a] added Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:08.580167 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:08.580469 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:43:08.580801 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:43:08.580993 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:43:08.659971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:08.659971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:08.776411 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:08.777261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:08.975611 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:09.225638 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:09.225852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:09.336582 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:09.336784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:09.582712 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:43:09.597528 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:09.611648 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:09.624390 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:09.624390 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:09.624638 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:09.624638 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:09.636949 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:09.658239 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a, portal: 192.168.40.100,3260] Jul 03 02:43:09.658239 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a, portal: 192.168.40.100,3260] successful. Jul 03 02:43:09.658239 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:09.669393 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] HCTL ('8', '-', '-', 0) found on session 236 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:43:09.682794 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:43:09.698444 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Searching for a device in session 236 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:09.698444 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f197a4e5-8e70-436b-a3e9-1893bd21379a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:43:09.889312 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:09.889449 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:09.990277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:09.990448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:10.195932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:10.440276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:10.440458 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:10.542289 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:10.542455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:10.704262 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.160s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:10.704878 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] <== connect_volume: return (2160ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799250', 'path': '/dev/sdc'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:10.705169 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:10.727403 np0000004352 sudo[161797]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 02:43:10.728204 np0000004352 sudo[161797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:10.748250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:10.996771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:10.996940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:11.079161 np0000004352 sudo[161797]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:11.081050 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.376s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:11.102842 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _create_container started, container: volumebackups,backup: 7f9c8e49-f008-4234-8aea-fec792155ebe. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:43:11.108197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:11.108197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:11.358339 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:11.365758 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] generate_object_name_prefix: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:43:11.373459 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] starting backup of volume: f197a4e5-8e70-436b-a3e9-1893bd21379a, volume size: 1073741824, object names prefix volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:43:11.582256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:11.654694 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:11.654831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:11.773005 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:11.773565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:11.824531 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:11.824902 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:11.933539 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:11.933696 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:11.980383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:12.151962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:12.245066 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:12.245188 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:12.352756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:12.352923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:12.426277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:12.426431 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:12.531488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:12.531730 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:12.556171 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:12.740731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:12.820923 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:12.821350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:12.936232 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:12.936382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:12.997027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:12.997185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:13.099807 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:13.099997 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:13.155158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:13.323179 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:13.419042 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:13.419278 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:13.539057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:13.539736 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:13.582492 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:13.582492 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:13.686456 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:13.686639 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:13.802442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:13.941978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:14.066335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:14.066504 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:14.194077 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:14.194308 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:14.206341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:14.206568 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:14.318038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:14.318172 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:14.480930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:14.597737 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:14.744176 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:14.744457 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:14.866553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:14.866754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:14.877532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:14.877677 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:14.992191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:14.992850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:15.090661 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:15.211583 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:15.349652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:15.349652 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:15.468591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:15.468591 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:15.478607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:15.478886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:15.590359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:15.590805 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:15.698776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:15.818607 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:15.951057 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:15.951222 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:16.059515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:16.059515 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:16.102457 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:16.102638 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:16.213937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:16.213937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:16.324731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:16.455788 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:16.581574 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:16.581709 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:16.691032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:16.691156 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:16.739935 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:16.740095 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:16.852169 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:16.856723 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:16.897979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:17.077606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:17.176440 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:17.176633 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:17.309712 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:17.310275 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:17.341304 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:17.341584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:17.448183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:17.448484 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:17.510819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:17.642727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:17.761230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:17.761230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:17.865327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:17.865327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:17.887735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:17.887903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:17.977044 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:17.988623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:17.988865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:18.110917 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:18.111341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:18.176706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup MD5 for volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:18.176912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:18.184654 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:43:18.191319 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:43:18.191576 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:43:18.196846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:43:18.197064 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:43:18.200999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:43:18.201236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:43:18.226601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:18.254655 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:43:18.255295 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _write_metadata started, container name: volumebackups, metadata filename: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:43:18.281891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "39cddc42-5bb7-4d65-998a-b894b63a307e",\n "backup_name": "tempest-CreateVolumesFromBackupTest-Backup-880735868",\n "created_at": "2026-07-03 02:43:02+00:00",\n "objects": [\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "459ac9a2-9f55-411d-bcf0-f5c442af8a67",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"459ac9a2-9f55-411d-bcf0-f5c442af8a67\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"daac2840f6df46e3893010406bf9633e\\", \\"project_id\\": \\"c9b37d0745fb4ee88f524a89b655e0ee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:01.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:01.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-CreateVolumesFromBackupTest-Volume-385938122\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:01.000000\\", \\"updated_at\\": \\"2026-07-03T02:43:02.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:43:18.290727 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] backup 39cddc42-5bb7-4d65-998a-b894b63a307e finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:43:18.423214 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:18.444943 np0000004352 sudo[161862]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:43:18.445682 np0000004352 sudo[161862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:18.504435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:18.504762 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:18.613362 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:18.613592 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:18.795016 np0000004352 sudo[161862]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:18.800318 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.377s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:18.802139 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000021f05848', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:18.803039 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:18.804767 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:18.805097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '459ac9a2-9f55-411d-bcf0-f5c442af8a67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:18.816791 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:18.817499 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:43:18.817499 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:43:18.817499 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:43:18.817499 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:43:18.838369 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('-m', 'session'): stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:18.838369 np0000004352 cinder-backup[101397]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:18.838369 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:18.838658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsi session list stdout=tcp: [235] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67 (non-flash) Jul 03 02:43:18.838658 np0000004352 cinder-backup[101397]: tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:18.838658 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:18.838764 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', '235'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', '236')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:43:18.838925 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67', '235')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:43:18.840097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Resulting device map defaultdict(. at 0x783584bb4680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:43:18.840276 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:43:18.849909 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:43:18.855695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:18.856658 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:43:18.905842 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:43:18.906003 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:43:18.906753 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:43:18.916979 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:43:18.917229 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:43:18.927754 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:18.953285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 235, target: iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67, portal: 192.168.40.100,3260] Jul 03 02:43:18.953285 np0000004352 cinder-backup[101397]: Logout of [sid: 235, target: iqn.2023-03.storpool.com:os--volume-459ac9a2-9f55-411d-bcf0-f5c442af8a67, portal: 192.168.40.100,3260] successful. Jul 03 02:43:18.953285 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:18.965587 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:18.965845 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.162s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:18.966053 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] <== disconnect_volume: return (163ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:19.096321 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:19.097266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:19.199070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:19.199605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:19.389717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:19.634499 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:19.634600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:19.733327 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:19.733563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:19.913670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:19.990806 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-480f344a-3623-47c2-86a1-554ed2aaa02f tempest-CreateVolumesFromBackupTest-462179149 None] Create backup finished. backup: 39cddc42-5bb7-4d65-998a-b894b63a307e. Jul 03 02:43:20.158033 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:20.158163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:20.254341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:20.255024 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:20.442764 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:20.686135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:20.686240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:20.786518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:20.786697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:21.013615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:21.294671 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:21.295230 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:21.403568 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:21.404468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:21.611262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:21.716428 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] Delete backup started, backup: 39cddc42-5bb7-4d65-998a-b894b63a307e. Jul 03 02:43:21.723325 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_c9b37d0745fb4ee88f524a89b655e0ee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:21.723695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:21.724026 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] delete started, backup: 39cddc42-5bb7-4d65-998a-b894b63a307e, container: volumebackups, prefix: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:43:21.769381 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] generated object list: ['volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00001', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00002', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00003', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00004', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00005', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00006', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00007', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00008', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00009', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00010', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00011', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00012', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00013', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00014', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00015', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00016', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00017', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00018', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00019', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00020', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00021', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_metadata', 'volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:43:21.790414 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.812501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.834669 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.859114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.867017 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:21.867324 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:21.883464 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.905954 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.926939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.952299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:21.971513 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:21.971774 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:22.003670 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.013313 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:22.033039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.083545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.126135 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.160056 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.196872 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.217180 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:22.220483 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.241847 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.265147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.288740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.314093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.333863 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.357850 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.379197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.401098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] deleted object: volume_459ac9a2-9f55-411d-bcf0-f5c442af8a67/20260703024305/az_nova_backup_39cddc42-5bb7-4d65-998a-b894b63a307e_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:22.401403 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] delete 39cddc42-5bb7-4d65-998a-b894b63a307e finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:43:22.417214 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] Created reservations ['351d7e91-1c8b-4ef8-b442-49ff2d722a76', '912aed77-8dcf-4820-b240-abc24e9dcd98'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:43:22.434269 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b702d5bb-de4a-491a-8d08-27e61ecda49e tempest-CreateVolumesFromBackupTest-462179149 None] Delete backup finished, backup 39cddc42-5bb7-4d65-998a-b894b63a307e deleted. Jul 03 02:43:22.465630 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:22.465729 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:22.565013 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:22.565130 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:22.784209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:23.069663 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:23.069980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:23.172703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:23.172912 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:23.286576 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:23.412185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:23.412782 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:23.489575 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:23.489827 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:23.499629 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:43:23.507865 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:43:23.508044 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:43:23.513717 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:43:23.513936 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:43:23.518120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:43:23.518502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:43:23.580642 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:43:23.581506 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _write_metadata started, container name: volumebackups, metadata filename: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:43:23.606891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "7f9c8e49-f008-4234-8aea-fec792155ebe",\n "backup_name": "tempest-VolumesBackupsTest-Backup-323404149",\n "created_at": "2026-07-03 02:43:08+00:00",\n "objects": [\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "f197a4e5-8e70-436b-a3e9-1893bd21379a",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"f197a4e5-8e70-436b-a3e9-1893bd21379a\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:07.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:07.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-361713160\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:07.000000\\", \\"updated_at\\": \\"2026-07-03T02:43:08.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:43:23.614532 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] backup 7f9c8e49-f008-4234-8aea-fec792155ebe finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:43:23.745785 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:23.765294 np0000004352 sudo[161896]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 02:43:23.766111 np0000004352 sudo[161896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:24.099694 np0000004352 sudo[161896]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:24.102154 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.356s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:24.102915 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f197a4e5-8e70-436b-a3e9-1893bd21379a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799250', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:24.103166 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:24.103822 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:24.104369 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f197a4e5-8e70-436b-a3e9-1893bd21379a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:24.115194 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:24.115663 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:43:24.115663 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:43:24.115663 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:43:24.115867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:43:24.138707 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:24.138707 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:24.138942 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [236] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a (non-flash) Jul 03 02:43:24.138942 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:24.139101 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', '236')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:43:24.139328 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a', '236')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:43:24.140218 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Resulting device map defaultdict(. at 0x78357a4ecae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a'): ({'sdc'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:43:24.140510 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Removing single pathed devices sdc {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:43:24.154103 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Flushing IO for device /dev/sdc {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:43:24.163371 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:43:24.215208 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:43:24.215502 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:43:24.216449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:43:24.228190 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:43:24.228637 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:43:24.240864 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:24.273709 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 236, target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a, portal: 192.168.40.100,3260] Jul 03 02:43:24.273709 np0000004352 cinder-backup[101397]: Logout of [sid: 236, target: iqn.2023-03.storpool.com:os--volume-f197a4e5-8e70-436b-a3e9-1893bd21379a, portal: 192.168.40.100,3260] successful. Jul 03 02:43:24.273709 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:24.283744 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:24.284092 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.180s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:24.284320 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] <== disconnect_volume: return (181ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:25.308705 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-ee849713-fbbe-44b5-8cdb-5c9cdb59e596 tempest-VolumesBackupsTest-986908416 None] Create backup finished. backup: 7f9c8e49-f008-4234-8aea-fec792155ebe. Jul 03 02:43:26.481328 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] Delete backup started, backup: 7f9c8e49-f008-4234-8aea-fec792155ebe. Jul 03 02:43:26.485274 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:26.485517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:26.485752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] delete started, backup: 7f9c8e49-f008-4234-8aea-fec792155ebe, container: volumebackups, prefix: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:43:26.530909 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] generated object list: ['volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00001', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00002', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00003', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00004', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00005', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00006', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00007', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00008', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00009', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00010', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00011', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00012', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00013', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00014', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00015', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00016', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00017', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00018', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00019', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00020', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00021', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_metadata', 'volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:43:26.554318 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.575957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.596545 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.617505 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.641348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.667693 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.695892 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.717404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.738285 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.761349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.782241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.806251 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.830182 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.852476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.874734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.893394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.913771 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.933962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.952079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.976720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:26.999348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:27.022489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:27.049294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_f197a4e5-8e70-436b-a3e9-1893bd21379a/20260703024311/az_nova_backup_7f9c8e49-f008-4234-8aea-fec792155ebe_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:27.049294 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] delete 7f9c8e49-f008-4234-8aea-fec792155ebe finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:43:27.081545 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:27.095446 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] Created reservations ['a495b87d-bf91-4278-ac11-c620ac1dae68', '60288de8-506c-4618-91f0-06343473e805'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:43:27.111822 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e909ba8b-cbf8-4a66-b469-8c1662cb9260 tempest-VolumesBackupsTest-986908416 None] Delete backup finished, backup 7f9c8e49-f008-4234-8aea-fec792155ebe deleted. Jul 03 02:43:28.859153 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Create backup started, backup: 22922512-1f72-40a1-b03d-d5184fe48a7c volume: d13bc310-b60e-45bc-b196-2f490d0c3901. Jul 03 02:43:28.864643 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:43:28Z,data_timestamp=2026-07-03T02:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-255758589',encryption_key_id=None,fail_reason=None,host='np0000004352',id=22922512-1f72-40a1-b03d-d5184fe48a7c,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='bda7a6a35b64470488d330119aff58ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b74f1b37e30344498c9d64b488e4e9dd',volume_id=d13bc310-b60e-45bc-b196-2f490d0c3901) Jul 03 02:43:28.889114 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:28.889373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:28.889729 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:28.902597 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:43:28.928004 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:28.941032 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:43:28.941502 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:43:28.950038 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:43:28.951232 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:43:28.951443 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:43:28.951607 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:43:28.951948 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] <== get_connector_properties: return (62ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:29.456325 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:43:29.456823 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd13bc310-b60e-45bc-b196-2f490d0c3901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:29.457001 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:29.457590 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:29.457802 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd13bc310-b60e-45bc-b196-2f490d0c3901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:43:29.469706 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:29.470238 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:29.470577 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:29.481695 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:43:29.481695 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901] added Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:29.493984 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:29.494271 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:43:29.494596 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:43:29.494784 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:43:30.495887 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:43:30.507205 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:30.519998 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:30.529982 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:30.529982 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:30.529982 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:30.529982 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:30.530122 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:43:30.530122 np0000004352 cinder-backup[101397]: Jul 03 02:43:30.562973 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901, portal: 192.168.40.100,3260] Jul 03 02:43:30.562973 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901, portal: 192.168.40.100,3260] successful. Jul 03 02:43:30.562973 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:30.572989 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:30.584189 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [237] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 (non-flash) Jul 03 02:43:30.584189 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:30.584375 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [237] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 (non-flash) Jul 03 02:43:30.584375 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:30.584713 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:30.584889 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:43:30.585463 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] HCTL ('7', '-', '-', 0) found on session 237 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:43:30.585624 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:43:30.603180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Searching for a device in session 237 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:30.603180 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd13bc310-b60e-45bc-b196-2f490d0c3901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:43:31.603750 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.146s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:31.604262 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] <== connect_volume: return (2147ms) {'type': 'block', 'scsi_wwn': '330000000eeda02aa', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:31.604381 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:31.625454 np0000004352 sudo[162008]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:43:31.626254 np0000004352 sudo[162008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:31.942436 np0000004352 sudo[162008]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:31.944512 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.340s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:31.981696 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:31.989266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _create_container started, container: volumebackups,backup: 22922512-1f72-40a1-b03d-d5184fe48a7c. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:43:32.181606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] generate_object_name_prefix: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:43:32.191940 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] starting backup of volume: d13bc310-b60e-45bc-b196-2f490d0c3901, volume size: 1073741824, object names prefix volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:43:32.383098 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:32.623301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:32.623720 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:32.727697 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:32.727867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:32.918083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:33.169383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:33.169589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:33.272893 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:33.273157 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:33.275093 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=121,cinder:UPDATE=40,cinder:INSERT=6 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:43:33.477705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:33.728106 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:33.728576 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:33.827535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:33.827718 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:34.009448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:34.256346 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:34.256510 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:34.358930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:34.359120 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:34.544238 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:34.795501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:34.795819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:34.895572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:34.895761 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:35.097679 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:35.349608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:35.349768 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:35.455090 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:35.455297 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:35.646699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:35.898569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:35.898569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:36.001107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:36.001302 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:36.188775 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:36.455979 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:36.456122 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:36.554934 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:36.555116 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:36.751900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:37.004456 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:37.004852 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:37.107002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:37.107247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:37.321561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:37.579707 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:37.580036 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:37.682685 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:37.682855 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:37.878894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:38.129516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:38.129976 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:38.229485 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:38.229605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:38.414611 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:38.664854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:38.665028 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:38.764517 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:38.764711 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:39.008552 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:39.265748 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:39.266347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:39.367820 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:39.367985 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:39.548280 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:39.790527 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:39.790678 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:39.890972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:39.891196 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:40.105093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:40.363903 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:40.364466 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:40.477553 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:40.477706 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:40.728628 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:41.007187 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:41.007400 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:41.115261 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:41.115464 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:41.301754 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:41.549615 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:41.550062 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:41.649259 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:41.649461 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:41.836699 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:42.087605 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:42.087791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:42.187272 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:42.187520 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:42.384019 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:42.630598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:42.631079 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:42.735121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:42.735269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:42.916877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:43.176348 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:43.176516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:43.279465 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:43.279703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:43.379728 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:43.496183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:43.496349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:43.556603 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:43.556826 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:43.564311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:43:43.572105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:43:43.572365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:43:43.577574 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:43:43.577886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:43:43.582394 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:43:43.582834 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:43:43.643962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:43:43.644900 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _write_metadata started, container name: volumebackups, metadata filename: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:43:43.670753 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "22922512-1f72-40a1-b03d-d5184fe48a7c",\n "backup_name": "tempest-VolumesBackupsTest-Backup-255758589",\n "created_at": "2026-07-03 02:43:29+00:00",\n "objects": [\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "d13bc310-b60e-45bc-b196-2f490d0c3901",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"d13bc310-b60e-45bc-b196-2f490d0c3901\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#default\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:28.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:28.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1595816377\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:28.000000\\", \\"updated_at\\": \\"2026-07-03T02:43:29.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:43:43.678489 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] backup 22922512-1f72-40a1-b03d-d5184fe48a7c finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:43:43.806277 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:43.822242 np0000004352 sudo[162016]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:43:43.822883 np0000004352 sudo[162016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:44.122554 np0000004352 sudo[162016]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:44.124666 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.318s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:44.125295 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd13bc310-b60e-45bc-b196-2f490d0c3901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '330000000eeda02aa', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:44.125502 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:44.126148 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:44.126693 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd13bc310-b60e-45bc-b196-2f490d0c3901', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:43:44.137724 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:44.138222 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:43:44.138222 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:43:44.138222 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:43:44.138222 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:43:44.160293 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [237] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 (non-flash) Jul 03 02:43:44.160293 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:44.160610 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [237] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901 (non-flash) Jul 03 02:43:44.160610 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:44.160867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', '237')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:43:44.161049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901', '237')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:43:44.161972 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Resulting device map defaultdict(. at 0x78357a7f5c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:43:44.162192 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:43:44.175785 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:43:44.185444 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:43:44.240024 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:43:44.240146 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:43:44.240891 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:43:44.251983 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:43:44.252194 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:43:44.263303 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:44.292948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 237, target: iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901, portal: 192.168.40.100,3260] Jul 03 02:43:44.292948 np0000004352 cinder-backup[101397]: Logout of [sid: 237, target: iqn.2023-03.storpool.com:os--volume-d13bc310-b60e-45bc-b196-2f490d0c3901, portal: 192.168.40.100,3260] successful. Jul 03 02:43:44.292948 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:44.306055 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:44.306316 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.180s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:44.306506 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] <== disconnect_volume: return (180ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:45.329270 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-35368adb-5624-4143-9c8b-88ad7231fbcd tempest-VolumesBackupsTest-483130512 None] Create backup finished. backup: 22922512-1f72-40a1-b03d-d5184fe48a7c. Jul 03 02:43:46.290151 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] Delete backup started, backup: 22922512-1f72-40a1-b03d-d5184fe48a7c. Jul 03 02:43:46.294676 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:46.294853 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:46.295065 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] delete started, backup: 22922512-1f72-40a1-b03d-d5184fe48a7c, container: volumebackups, prefix: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:43:46.339875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] generated object list: ['volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00001', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00002', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00003', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00004', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00005', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00006', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00007', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00008', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00009', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00010', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00011', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00012', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00013', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00014', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00015', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00016', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00017', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00018', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00019', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00020', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00021', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_metadata', 'volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:43:46.362185 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.381888 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.401355 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.420055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.443198 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.466202 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.486373 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.506929 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.527032 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.548914 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.568894 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.588347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.606544 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.625938 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.643620 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.660344 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.678051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.696816 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.716535 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.735891 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.755702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.773811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.796197 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] deleted object: volume_d13bc310-b60e-45bc-b196-2f490d0c3901/20260703024332/az_nova_backup_22922512-1f72-40a1-b03d-d5184fe48a7c_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:43:46.796360 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] delete 22922512-1f72-40a1-b03d-d5184fe48a7c finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:43:46.825876 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:46.838677 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] Created reservations ['ee98467f-311a-4eac-94b0-763782253390', 'c5e68698-377a-428a-8566-d346b878bf8e'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:43:46.855243 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-dbe027fe-eb03-4eb7-ba7d-14f9c313447a tempest-VolumesBackupsTest-483130512 None] Delete backup finished, backup 22922512-1f72-40a1-b03d-d5184fe48a7c deleted. Jul 03 02:43:48.648619 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Create backup started, backup: 9fa1b327-dafa-4ce8-9db4-257604a409d7 volume: 2f0693c1-162c-467c-b993-b77851797cb9. Jul 03 02:43:48.653828 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:43:48Z,data_timestamp=2026-07-03T02:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-313549771',encryption_key_id=None,fail_reason=None,host='np0000004352',id=9fa1b327-dafa-4ce8-9db4-257604a409d7,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='bda7a6a35b64470488d330119aff58ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b74f1b37e30344498c9d64b488e4e9dd',volume_id=2f0693c1-162c-467c-b993-b77851797cb9) Jul 03 02:43:48.676444 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:48.676701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:48.677030 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:48.687443 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:43:48.707830 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:48.717959 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:43:48.718195 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:43:48.725847 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:43:48.726728 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:43:48.726906 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:43:48.727049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:43:48.727280 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] <== get_connector_properties: return (49ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:49.231062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:43:49.231578 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:49.231826 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:49.232361 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:49.232677 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:43:49.246733 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:49.247231 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:49.247527 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:49.259958 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:43:49.259958 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9] added Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:49.272263 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:49.272653 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:43:49.272846 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:43:49.273060 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:43:50.274136 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:43:50.285255 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:50.296867 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:50.307642 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:50.307642 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:50.307844 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:43:50.307844 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:50.308056 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:43:50.308056 np0000004352 cinder-backup[101397]: Jul 03 02:43:50.341958 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:43:50.341958 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:43:50.341958 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:50.353295 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:50.365331 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:50.365331 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:50.365531 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:50.365531 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:50.365948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.119s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:50.365948 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:43:50.366441 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] HCTL ('7', '-', '-', 0) found on session 238 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:43:50.366606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:43:50.380550 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Searching for a device in session 238 and hctl ['7', '*', '*', 0] yield: None {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:50.422450 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:50.429018 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Create backup started, backup: a0ed7346-26ac-4894-916d-e343b31891ac volume: 53d7d851-c24c-4dae-a41d-bca4cd6587f8. Jul 03 02:43:50.437205 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:43:50Z,data_timestamp=2026-07-03T02:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-type-Backup-973536836',encryption_key_id=None,fail_reason=None,host='np0000004352',id=a0ed7346-26ac-4894-916d-e343b31891ac,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='485d3e05c5a54f6a80751404ff1012df',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='40f03c687a2a4868816b12cfec4d72f3',volume_id=53d7d851-c24c-4dae-a41d-bca4cd6587f8) Jul 03 02:43:50.464716 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_485d3e05c5a54f6a80751404ff1012df {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:43:50.465518 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:43:50.465518 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:50.476150 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:43:50.498520 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:50.509012 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:43:50.509280 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:43:50.519143 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:43:50.520037 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:43:50.520182 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:43:50.520320 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:43:50.520654 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:51.025110 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:43:51.025730 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:43:51.025988 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:51.380197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Searching for a device in session 238 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:51.380741 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:43:51.381301 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.149s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:51.381514 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] <== connect_volume: return (2149ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:51.381870 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:51.388481 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.361s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:51.388975 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:43:51.397696 np0000004352 sudo[162122]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:43:51.398277 np0000004352 sudo[162122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:51.399910 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:43:51.400446 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:43:51.400757 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:51.410751 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:43:51.410751 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8] added Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:43:51.422080 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:51.422458 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:43:51.422717 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:43:51.422931 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:43:51.717598 np0000004352 sudo[162122]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:51.719391 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.337s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:51.759986 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:43:51.766332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _create_container started, container: volumebackups,backup: 9fa1b327-dafa-4ce8-9db4-257604a409d7. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:43:51.795991 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] generate_object_name_prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:43:51.804488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] starting backup of volume: 2f0693c1-162c-467c-b993-b77851797cb9, volume size: 1073741824, object names prefix volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:43:51.980705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:52.224866 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:52.225030 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:52.325194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:52.325301 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:52.424256 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:43:52.436206 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:52.448598 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:52.459062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('-m', 'session'): stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:52.459062 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:52.459062 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsi session list stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:52.459062 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:52.491455 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8, portal: 192.168.40.100,3260] Jul 03 02:43:52.491455 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8, portal: 192.168.40.100,3260] successful. Jul 03 02:43:52.491455 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:52.502049 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:43:52.513858 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('-m', 'session'): stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:52.513858 np0000004352 cinder-backup[101397]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:43:52.513858 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:43:52.514102 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsi session list stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:43:52.514102 np0000004352 cinder-backup[101397]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:43:52.514102 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:43:52.514673 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:52.514898 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:43:52.515753 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] HCTL ('8', '-', '-', 0) found on session 239 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:43:52.515904 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Scanning host 8 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:43:52.523457 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:52.529530 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Searching for a device in session 239 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:43:52.529772 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:43:52.771589 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:52.771750 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:52.876703 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:52.876922 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:53.064796 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:53.303011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:53.303123 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:53.407811 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:53.407980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:53.532110 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.145s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:43:53.532597 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] <== connect_volume: return (2506ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799272', 'path': '/dev/sdc'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:43:53.532795 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:43:53.555645 np0000004352 sudo[162172]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc Jul 03 02:43:53.556372 np0000004352 sudo[162172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:43:53.610299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:53.856606 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:53.856837 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:53.876868 np0000004352 sudo[162172]: pam_unix(sudo:session): session closed for user root Jul 03 02:43:53.878777 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdc" returned: 0 in 0.346s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:43:53.889741 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _create_container started, container: volumebackups,backup: a0ed7346-26ac-4894-916d-e343b31891ac. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:43:53.965088 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:53.965247 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:54.057972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] generate_object_name_prefix: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:43:54.064434 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] starting backup of volume: 53d7d851-c24c-4dae-a41d-bca4cd6587f8, volume size: 1073741824, object names prefix volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:43:54.170478 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:54.258023 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:54.424176 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:54.424310 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:54.506043 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:54.506220 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:54.532972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:54.533406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:54.620102 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:54.620289 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:54.747564 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:54.823397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:54.998926 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:54.999061 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:55.085214 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:55.085341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:55.098085 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:55.098306 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:55.187439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:55.187595 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:55.328602 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:55.413674 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:55.582964 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:55.583382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:55.657488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:55.657664 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:55.683818 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:55.683975 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:55.755338 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:55.755537 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:55.895645 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:55.968468 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:56.141004 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:56.141149 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:56.225516 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:56.225650 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:56.242359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:56.242563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:56.332338 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:56.332627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:56.489476 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:56.580608 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:56.735541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:56.735541 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:56.831211 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:56.831506 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:56.855740 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:56.855875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:56.943810 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:56.944008 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:57.087376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:57.180928 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:57.365323 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:57.365473 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:57.452805 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:57.452944 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:57.468819 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:57.469001 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:57.554738 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:57.554957 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:57.699598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:57.794183 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:57.954412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:57.954572 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:58.042937 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:58.043335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:58.064672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:58.065277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:58.155967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:58.155967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:58.362191 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:58.443797 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:58.634617 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:58.634766 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:58.679867 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:58.680093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:58.744158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:58.744413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:58.782078 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:58.782296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:59.032795 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:59.066347 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:59.282695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:59.282921 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:59.311486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:43:59.311698 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:43:59.399986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:59.400151 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:59.424296 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:43:59.425058 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:43:59.741014 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:43:59.759930 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:00.011986 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:00.012138 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:00.014735 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:00.014961 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:00.122901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:00.123313 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:00.125181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:00.125365 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:00.491242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:00.497971 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:00.740959 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:00.741174 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:00.744412 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:00.744580 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:00.853192 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:00.853451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:00.860721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:00.860886 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:01.176492 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:01.177290 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:01.433641 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:01.433777 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:01.442060 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:01.442241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:01.543201 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:01.543358 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:01.546133 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:01.546331 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:01.885406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:01.885846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:02.145129 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:02.145286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:02.145639 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:02.145789 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:02.264173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:02.264173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:02.265361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:02.265514 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:02.577454 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:02.577673 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:02.824398 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:02.824598 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:02.839221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:02.839410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:02.942665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:02.942911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:02.947651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:02.947831 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:03.085563 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:44:03.085563 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:44:03.293286 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:03.294086 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:03.574281 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:03.574410 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:03.580136 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:03.580351 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:03.685231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:03.685463 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:03.686838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:03.687027 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:04.004070 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:04.005799 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:04.254392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:04.254392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:04.256967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:04.256967 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:04.362277 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:04.362747 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:04.372460 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:04.372752 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:04.521823 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:04.602611 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:04.645556 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:04.645710 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:04.713775 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:04.714008 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:04.722732 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:44:04.731397 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:44:04.731861 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:44:04.737963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:44:04.738268 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:44:04.742690 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:44:04.743266 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:44:04.819977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:44:04.820868 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:44:04.853441 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "9fa1b327-dafa-4ce8-9db4-257604a409d7",\n "backup_name": "tempest-VolumesBackupsTest-Backup-313549771",\n "created_at": "2026-07-03 02:43:49+00:00",\n "objects": [\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2f0693c1-162c-467c-b993-b77851797cb9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2f0693c1-162c-467c-b993-b77851797cb9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:48.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1933821741\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:47.000000\\", \\"updated_at\\": \\"2026-07-03T02:43:49.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:44:04.859790 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:04.860089 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:04.862025 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] backup 9fa1b327-dafa-4ce8-9db4-257604a409d7 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:44:04.989863 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:05.012609 np0000004352 sudo[162179]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:44:05.013191 np0000004352 sudo[162179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:05.076594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:05.076743 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:05.294439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:05.379392 np0000004352 sudo[162179]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:05.381481 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.392s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:05.382296 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:05.382650 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:05.383314 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:05.383873 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:05.396379 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:05.396862 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:44:05.396862 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:44:05.396862 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:44:05.397155 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:44:05.422172 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:05.422172 np0000004352 cinder-backup[101397]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:05.422172 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:05.422399 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [238] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:05.422399 np0000004352 cinder-backup[101397]: tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:05.422399 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:05.422515 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '238'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', '239')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:44:05.422769 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '238')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:44:05.423860 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Resulting device map defaultdict(. at 0x78357a0a2840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:44:05.424176 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:44:05.436621 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:44:05.445960 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:44:05.494135 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:44:05.494357 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:44:05.495409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:44:05.508837 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:44:05.509256 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:44:05.524972 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:05.558260 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 238, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:05.558260 np0000004352 cinder-backup[101397]: Logout of [sid: 238, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:05.558260 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:05.573604 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:05.573976 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.191s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:05.574173 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] <== disconnect_volume: return (191ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:05.576405 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:05.576609 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:05.691757 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:05.691947 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:05.904559 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:06.168413 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:06.168651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:06.269889 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:06.270102 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:06.478141 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:06.595640 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-de6d33ed-ae97-4062-96b7-4b97c1b80f29 tempest-VolumesBackupsTest-483130512 None] Create backup finished. backup: 9fa1b327-dafa-4ce8-9db4-257604a409d7. Jul 03 02:44:06.734451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:06.734638 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:06.837012 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:06.837337 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:06.937495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:07.059578 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:07.059719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:07.111118 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Create backup started, backup: 4e2d83d7-7c44-42cd-ab57-5c883003ec08 volume: 2f0693c1-162c-467c-b993-b77851797cb9. Jul 03 02:44:07.119667 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:44:07Z,data_timestamp=2026-07-03T02:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-2055611075',encryption_key_id=None,fail_reason=None,host='np0000004352',id=4e2d83d7-7c44-42cd-ab57-5c883003ec08,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='1c90cac2fc954e8f9955fb497cbecdee',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8944104afe174b6fb7371bffc9897515',volume_id=2f0693c1-162c-467c-b993-b77851797cb9) Jul 03 02:44:07.123011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup MD5 for volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:07.123240 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:07.132273 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:44:07.142567 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:44:07.142721 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:44:07.151437 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:07.151627 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:07.151936 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:07.185697 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:44:07.190799 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:07.193074 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:44:07.193194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:44:07.197010 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:44:07.197326 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:44:07.220995 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:07.235011 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:44:07.235555 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:44:07.245755 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:44:07.246717 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:44:07.246895 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:44:07.247048 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:44:07.247380 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:07.273248 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:44:07.274246 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _write_metadata started, container name: volumebackups, metadata filename: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:44:07.311776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "a0ed7346-26ac-4894-916d-e343b31891ac",\n "backup_name": "tempest-type-Backup-973536836",\n "created_at": "2026-07-03 02:43:50+00:00",\n "objects": [\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "53d7d851-c24c-4dae-a41d-bca4cd6587f8",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"53d7d851-c24c-4dae-a41d-bca4cd6587f8\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"40f03c687a2a4868816b12cfec4d72f3\\", \\"project_id\\": \\"485d3e05c5a54f6a80751404ff1012df\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:49.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:49.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumeV3RbacBaseTests-Volume-2147368969\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:49.000000\\", \\"updated_at\\": \\"2026-07-03T02:43:50.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:44:07.321043 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] backup a0ed7346-26ac-4894-916d-e343b31891ac finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:44:07.471459 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:07.489177 np0000004352 sudo[162226]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc Jul 03 02:44:07.489822 np0000004352 sudo[162226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:07.752854 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:44:07.753338 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:07.753462 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:07.753984 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:07.754204 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:44:07.765152 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:07.765528 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:07.765752 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:07.775767 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:44:07.775767 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9] added Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:07.787472 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:07.787716 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:44:07.788325 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0224(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:44:07.788624 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:44:07.812441 np0000004352 sudo[162226]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:07.814634 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdc" returned: 0 in 0.343s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:07.815309 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799272', 'path': '/dev/sdc'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:07.815529 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:08.789938 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:44:08.800704 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:08.810871 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:08.821588 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:08.821588 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:08.821756 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:08.821756 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:08.847659 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:08.847659 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:08.847659 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:08.858572 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:08.868999 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:08.868999 np0000004352 cinder-backup[101397]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:08.868999 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:08.869200 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:08.869200 np0000004352 cinder-backup[101397]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:08.869200 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:08.869394 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.104s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:08.869535 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:44:08.870127 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] HCTL ('7', '-', '-', 0) found on session 240 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:44:08.870254 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:44:08.882693 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Searching for a device in session 240 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:44:08.882693 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:44:09.885097 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.131s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:09.885687 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] <== connect_volume: return (2131ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:09.885782 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:09.893653 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.077s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:09.894560 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '53d7d851-c24c-4dae-a41d-bca4cd6587f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:44:09.903791 np0000004352 sudo[162284]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:44:09.904624 np0000004352 sudo[162284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:09.907576 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:09.907962 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:44:09.907962 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:44:09.907962 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:44:09.908109 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:44:09.931926 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('-m', 'session'): stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:09.931926 np0000004352 cinder-backup[101397]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:09.931926 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:09.932187 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsi session list stdout=tcp: [239] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8 (non-flash) Jul 03 02:44:09.932187 np0000004352 cinder-backup[101397]: tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:09.932187 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:09.932279 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', '239'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '240')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:44:09.932354 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8', '239')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:44:09.933324 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Resulting device map defaultdict(. at 0x78357a906200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8'): ({'sdc'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:44:09.933562 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Removing single pathed devices sdc {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:44:09.943606 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Flushing IO for device /dev/sdc {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:44:09.953195 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:44:09.998084 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Checking to see if SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:44:09.998322 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] SCSI volumes sdc have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:44:09.999233 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Checking to see if device paths {'sdc'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:44:10.011477 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Device paths {'sdc'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:44:10.011711 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:44:10.024700 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:10.057449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 239, target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8, portal: 192.168.40.100,3260] Jul 03 02:44:10.057449 np0000004352 cinder-backup[101397]: Logout of [sid: 239, target: iqn.2023-03.storpool.com:os--volume-53d7d851-c24c-4dae-a41d-bca4cd6587f8, portal: 192.168.40.100,3260] successful. Jul 03 02:44:10.057449 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:10.069482 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:10.069875 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.177s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:10.070089 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] <== disconnect_volume: return (2254ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:10.266778 np0000004352 sudo[162284]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:10.268610 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.383s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:10.278573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _create_container started, container: volumebackups,backup: 4e2d83d7-7c44-42cd-ab57-5c883003ec08. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:44:10.313763 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] generate_object_name_prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:44:10.319343 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] starting backup of volume: 2f0693c1-162c-467c-b993-b77851797cb9, volume size: 1073741824, object names prefix volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:44:10.513621 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:10.765350 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:10.765533 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:10.876488 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00001: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:10.876731 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:11.061231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:11.089195 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-b80d75e1-7dbf-4b7a-8647-56787e7058c4 tempest-ProjectReaderTests39-1150403921 None] Create backup finished. backup: a0ed7346-26ac-4894-916d-e343b31891ac. Jul 03 02:44:11.307846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:11.308075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:11.407734 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00002: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:11.407911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:11.588968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:11.838932 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:11.839262 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:11.847972 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] Delete backup started, backup: a0ed7346-26ac-4894-916d-e343b31891ac. Jul 03 02:44:11.852010 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_485d3e05c5a54f6a80751404ff1012df {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:11.852194 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:11.852390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] delete started, backup: a0ed7346-26ac-4894-916d-e343b31891ac, container: volumebackups, prefix: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:44:11.899199 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] generated object list: ['volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00001', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00002', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00003', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00004', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00005', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00006', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00007', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00008', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00009', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00010', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00011', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00012', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00013', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00014', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00015', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00016', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00017', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00018', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00019', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00020', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00021', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_metadata', 'volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:44:11.921977 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:11.942498 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:11.956137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00003: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:11.956331 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:11.984742 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:11.994132 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:12.008002 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.033812 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.058877 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.080448 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.110439 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.131978 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.154219 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.177390 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.201626 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.223501 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.235080 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:12.245105 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.268335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.290514 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.312107 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.336300 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.356887 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.378486 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.400221 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.423939 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.442565 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] deleted object: volume_53d7d851-c24c-4dae-a41d-bca4cd6587f8/20260703024354/az_nova_backup_a0ed7346-26ac-4894-916d-e343b31891ac_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:12.442776 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] delete a0ed7346-26ac-4894-916d-e343b31891ac finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:44:12.457154 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] Created reservations ['50ce37ce-2b4a-4fd2-bf28-f2700b1cfd16', '54f9054b-f12e-43f7-93cb-14d34c8a6bd9'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:44:12.474162 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-284f5fa4-ee21-4738-b41c-88f8a88c5da9 tempest-ProjectReaderTests39-1150403921 None] Delete backup finished, backup a0ed7346-26ac-4894-916d-e343b31891ac deleted. Jul 03 02:44:12.524665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:12.524845 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:12.627051 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00004: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:12.627267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:12.844972 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:13.127558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:13.127558 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:13.230563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00005: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:13.230563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:13.454021 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:13.706958 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:13.707093 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:13.813263 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00006: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:13.813623 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:14.006228 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:14.265496 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:14.265931 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:14.369013 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00007: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:14.369236 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:14.592276 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:14.852404 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:14.852701 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:14.955767 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00008: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:14.956021 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:15.241376 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:15.501614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:15.501614 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:15.609687 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00009: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:15.609884 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:15.815956 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:16.069854 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:16.069999 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:16.172983 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00010: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:16.173127 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:16.389332 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:16.642121 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:16.642665 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:16.751899 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00011: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:16.752075 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:16.948451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:17.213790 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:17.213955 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:17.319349 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00012: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:17.319584 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:17.525536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:17.768672 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:17.769161 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:17.867045 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00013: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:17.867250 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:18.054600 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:18.314696 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:18.314859 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:18.420223 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00014: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:18.420555 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:18.599083 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:18.848455 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:18.848920 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:18.954142 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00015: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:18.954299 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:19.169235 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:19.436450 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:19.436639 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:19.540038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00016: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:19.540181 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:19.739322 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:19.986833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:19.987341 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:20.090569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00017: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:20.090705 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:20.285184 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:20.553136 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:20.553328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:20.667402 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00018: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:20.667833 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:20.924392 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:21.204000 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:21.204573 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:21.310377 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00019: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:21.310594 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:21.532086 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:21.783657 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 52428800 bytes of data to 50976 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:21.783822 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:21.886722 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00020: 25e317773f308e446cc84c503a6d1f85 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:21.886901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:21.980100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Backing up chunk of data from volume. {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:391}} Jul 03 02:44:22.094838 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Compressed 25165824 bytes of data to 24470 bytes using zlib. {{(pid=101397) _prepare_output_data /opt/stack/cinder/cinder/backup/chunkeddriver.py:430}} Jul 03 02:44:22.094998 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] About to put_object {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:394}} Jul 03 02:44:22.156134 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup MD5 for volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00021: 77377273b0a4b61febdbf7bbf52b9db9 {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:402}} Jul 03 02:44:22.156352 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Calling eventlet.sleep(0) {{(pid=101397) _backup_chunk /opt/stack/cinder/cinder/backup/chunkeddriver.py:409}} Jul 03 02:44:22.165118 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:44:22.172303 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:44:22.173011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:44:22.178242 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:44:22.178456 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:44:22.183163 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:44:22.183503 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:44:22.246406 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:44:22.247271 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:44:22.275370 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "4e2d83d7-7c44-42cd-ab57-5c883003ec08",\n "backup_name": "tempest-VolumesBackupsTest-Backup-2055611075",\n "created_at": "2026-07-03 02:44:07+00:00",\n "objects": [\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00001": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 0\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00002": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 52428800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00003": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 104857600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00004": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 157286400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00005": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 209715200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00006": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 262144000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00007": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 314572800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00008": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 367001600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00009": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 419430400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00010": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 471859200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00011": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 524288000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00012": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 576716800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00013": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 629145600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00014": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 681574400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00015": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 734003200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00016": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 786432000\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00017": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 838860800\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00018": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 891289600\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00019": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 943718400\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00020": {\n "compression": "zlib",\n "length": 52428800,\n "md5": "25e317773f308e446cc84c503a6d1f85",\n "offset": 996147200\n }\n },\n {\n "volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00021": {\n "compression": "zlib",\n "length": 25165824,\n "md5": "77377273b0a4b61febdbf7bbf52b9db9",\n "offset": 1048576000\n }\n }\n ],\n "parent_id": null,\n "version": "1.0.0",\n "volume_id": "2f0693c1-162c-467c-b993-b77851797cb9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2f0693c1-162c-467c-b993-b77851797cb9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:48.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1933821741\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:47.000000\\", \\"updated_at\\": \\"2026-07-03T02:44:07.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:44:22.282911 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] backup 4e2d83d7-7c44-42cd-ab57-5c883003ec08 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:44:22.422005 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:22.442594 np0000004352 sudo[162376]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:44:22.443227 np0000004352 sudo[162376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:22.828375 np0000004352 sudo[162376]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:22.830701 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.409s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:22.831397 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:22.831652 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:22.832175 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:22.832699 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:22.842920 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:22.843263 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:44:22.843263 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:44:22.843263 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:44:22.843430 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:44:22.863241 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:22.863241 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:22.863403 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [240] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:22.863403 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:22.863575 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '240')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:44:22.863716 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '240')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:44:22.864569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Resulting device map defaultdict(. at 0x78357a9077e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:44:22.864775 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:44:22.875254 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:44:22.884006 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:44:22.933565 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:44:22.933821 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:44:22.934920 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:44:22.948588 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:44:22.948928 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:44:22.961679 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:22.994813 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 240, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:22.994813 np0000004352 cinder-backup[101397]: Logout of [sid: 240, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:22.994813 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:23.006991 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:23.007325 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.175s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:23.007545 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] <== disconnect_volume: return (175ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:24.033794 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-8cedf181-cc30-4ca1-8281-e4215690754e tempest-VolumesBackupsTest-986908416 None] Create backup finished. backup: 4e2d83d7-7c44-42cd-ab57-5c883003ec08. Jul 03 02:44:24.626705 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Create backup started, backup: 1ed45c53-47dd-4c16-a226-4b2703a3955e volume: 2f0693c1-162c-467c-b993-b77851797cb9. Jul 03 02:44:24.632386 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:44:24Z,data_timestamp=2026-07-03T02:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1914171159',encryption_key_id=None,fail_reason=None,host='np0000004352',id=1ed45c53-47dd-4c16-a226-4b2703a3955e,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(9fa1b327-dafa-4ce8-9db4-257604a409d7),parent_id='9fa1b327-dafa-4ce8-9db4-257604a409d7',project_id='bda7a6a35b64470488d330119aff58ac',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b74f1b37e30344498c9d64b488e4e9dd',volume_id=2f0693c1-162c-467c-b993-b77851797cb9) Jul 03 02:44:24.663798 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:24.663963 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:24.664330 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:24.674534 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:44:24.693873 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:24.708918 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:44:24.709247 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:44:24.718235 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:44:24.719029 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:44:24.719156 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:44:24.719285 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:44:24.719544 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] <== get_connector_properties: return (54ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:25.223092 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:44:25.223628 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:25.223865 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:25.224405 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:25.224652 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:44:25.236817 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:25.237318 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:25.237707 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:25.249067 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:44:25.249067 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9] added Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:25.260762 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:25.261043 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:44:25.261404 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:44:25.261595 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:44:26.262723 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:44:26.274792 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:26.285461 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:26.296132 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:44:26.296132 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:26.296358 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:44:26.296358 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:26.296358 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:44:26.296358 np0000004352 cinder-backup[101397]: Jul 03 02:44:26.327956 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:26.327956 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:26.327956 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:26.337723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:26.348026 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:26.348026 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:26.348248 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:26.348248 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:26.348539 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:26.348675 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:44:26.349057 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] HCTL ('7', '-', '-', 0) found on session 241 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:44:26.349205 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:44:26.361776 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Searching for a device in session 241 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:44:26.362003 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:44:27.364343 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.140s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:27.364783 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] <== connect_volume: return (2140ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:27.365040 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:27.385445 np0000004352 sudo[162476]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:44:27.386100 np0000004352 sudo[162476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:27.695980 np0000004352 sudo[162476]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:27.698595 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.333s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:27.734364 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:27.743836 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:44:27.777311 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:44:27.784030 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _create_container started, container: volumebackups,backup: 1ed45c53-47dd-4c16-a226-4b2703a3955e. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:44:27.816382 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] generate_object_name_prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:44:27.825100 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] starting backup of volume: 2f0693c1-162c-467c-b993-b77851797cb9, volume size: 1073741824, object names prefix volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:44:32.137050 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:44:32.144702 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:44:32.144902 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:44:32.149875 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:44:32.150055 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:44:32.153768 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:44:32.154067 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:44:32.230645 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:44:32.231414 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:44:32.265536 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "1ed45c53-47dd-4c16-a226-4b2703a3955e",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1914171159",\n "created_at": "2026-07-03 02:44:25+00:00",\n "objects": [],\n "parent_id": "9fa1b327-dafa-4ce8-9db4-257604a409d7",\n "version": "1.0.0",\n "volume_id": "2f0693c1-162c-467c-b993-b77851797cb9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2f0693c1-162c-467c-b993-b77851797cb9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:48.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1933821741\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:47.000000\\", \\"updated_at\\": \\"2026-07-03T02:44:25.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:44:32.270990 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] backup 1ed45c53-47dd-4c16-a226-4b2703a3955e finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:44:32.398361 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:32.416114 np0000004352 sudo[162486]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:44:32.416887 np0000004352 sudo[162486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:32.726170 np0000004352 sudo[162486]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:32.728245 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.330s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:32.728870 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799271', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:32.729087 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:32.729569 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:32.729908 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:32.740031 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:32.740324 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:44:32.740324 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:44:32.740324 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:44:32.740576 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:44:32.760887 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('-m', 'session'): stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:32.760887 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:32.761083 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsi session list stdout=tcp: [241] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:32.761083 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:32.761261 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '241')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:44:32.761470 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '241')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:44:32.762275 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Resulting device map defaultdict(. at 0x78357a535300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:44:32.762521 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:44:32.775010 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:44:32.783494 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:44:32.821934 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:44:32.822166 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:44:32.822890 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:44:32.834678 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:44:32.835058 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:44:32.846634 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:32.884828 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 241, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:32.884828 np0000004352 cinder-backup[101397]: Logout of [sid: 241, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:32.884828 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:32.894969 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:32.895207 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.166s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:32.895317 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] <== disconnect_volume: return (166ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:33.902667 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=164,cinder:UPDATE=37,cinder:INSERT=4 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:44:33.920989 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0467af0a-5d2b-4f4a-9917-da6984f54444 tempest-VolumesBackupsTest-483130512 None] Create backup finished. backup: 1ed45c53-47dd-4c16-a226-4b2703a3955e. Jul 03 02:44:34.962219 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Create backup started, backup: a117e5c2-8543-4508-b7e7-ad1a2448a885 volume: 2f0693c1-162c-467c-b993-b77851797cb9. Jul 03 02:44:34.969575 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Call Volume Manager to get_backup_device for Backup(availability_zone='nova',container=None,created_at=2026-07-03T02:44:34Z,data_timestamp=2026-07-03T02:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1211153510',encryption_key_id=None,fail_reason=None,host='np0000004352',id=a117e5c2-8543-4508-b7e7-ad1a2448a885,metadata={},num_dependent_backups=0,object_count=0,parent=Backup(4e2d83d7-7c44-42cd-ab57-5c883003ec08),parent_id='4e2d83d7-7c44-42cd-ab57-5c883003ec08',project_id='1c90cac2fc954e8f9955fb497cbecdee',restore_volume_id=None,service='cinder.backup.drivers.swift.SwiftBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8944104afe174b6fb7371bffc9897515',volume_id=2f0693c1-162c-467c-b993-b77851797cb9) Jul 03 02:44:34.995196 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:34.995429 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:34.995710 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.4.3.223', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:35.006284 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.scaleio [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=101397) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jul 03 02:44:35.027507 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): nvme version {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:35.038755 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] 'nvme version' failed. Not Retrying. {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 02:44:35.039022 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] nvme not present on system {{(pid=101397) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jul 03 02:44:35.046559 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=101397) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jul 03 02:44:35.047437 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.lightos [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Current host hostNQN and IP(s) are ['10.4.3.223', 'fe80::f816:3eff:fef2:ef1d', '192.168.40.6', 'fe80::f816:3eff:feba:3ec', '192.168.50.6', 'fe80::f816:3eff:fe32:ddc0', '192.168.10.6', 'fe80::f816:3eff:fe96:3109', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::98ab:6cff:fe38:9447'] Jul 03 02:44:35.047587 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jul 03 02:44:35.047716 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.lightos [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] LIGHTOS: no hostnqn found. {{(pid=101397) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jul 03 02:44:35.047990 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] <== get_connector_properties: return (52ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.223', 'host': 'np0000004352', 'multipath': False, 'enforce_multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a2633a05d73', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '80a8c083-552c-46a2-8db9-fd9e83fa2364', 'nvme_native_multipath': False} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:35.552378 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connector [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Factory for iscsi on None {{(pid=101397) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jul 03 02:44:35.552813 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:35.553041 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:35.553540 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:35.553743 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Connection properties {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jul 03 02:44:35.564370 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:35.564742 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:35.564973 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:35.577445 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Jul 03 02:44:35.577445 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9] added Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: stderr=iscsiadm: Config file line 363 does not have value Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: iscsiadm: Config file line 363 does not have value Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jul 03 02:44:35.588197 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:35.588449 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=101397) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jul 03 02:44:35.588761 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jul 03 02:44:35.588983 np0000004352 cinder-backup[101397]: DEBUG os_brick.utils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=101397) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jul 03 02:44:36.591098 np0000004352 cinder-backup[101397]: INFO os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Trying to connect to iSCSI portal 192.168.40.100:3260 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.name = iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.tpgt = -1 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.startup = manual Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.leading_login = No Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.iscsi_ifacename = default Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.net_ifacename = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.ipaddress = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.prefix_len = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.hwaddress = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.transport_name = tcp Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.initiatorname = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.vlan_id = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.vlan_priority = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.vlan_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.iface_num = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.mtu = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.port = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.bootproto = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.subnet_mask = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.gateway = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_alt_client_id = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_dns = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_learn_iqn = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_req_vendor_id_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_vendor_id = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.dhcp_slp_da = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.fragmentation = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.gratuitous_arp = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.incoming_forwarding = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tos_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tos = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.ttl = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.delayed_ack = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tcp_nagle = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tcp_wsf_state = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tcp_wsf = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tcp_timer_scale = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.tcp_timestamp = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.redirect = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.def_task_mgmt_timeout = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.header_digest = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.data_digest = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.immediate_data = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.initial_r2t = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.data_seq_inorder = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.data_pdu_inorder = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.erl = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.max_receive_data_len = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.first_burst_len = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.max_outstanding_r2t = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.max_burst_len = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.chap_auth = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.bidi_chap = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.strict_login_compliance = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.discovery_auth = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: iface.discovery_logout = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.discovery_address = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.discovery_port = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.discovery_type = fw Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.initial_cmdsn = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.initial_login_retry_max = 8 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.xmit_thread_priority = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.cmds_max = 128 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.queue_depth = 32 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.nr_sessions = 1 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.authmethod = None Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.username = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.password = *** Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.username_in = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.password_in = Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.auth.chap_algs = SHA256 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.timeo.replacement_timeout = 120 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.err_timeo.abort_timeout = 15 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.err_timeo.lu_reset_timeout = 30 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.err_timeo.tgt_reset_timeout = 30 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.err_timeo.host_reset_timeout = 60 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.FastAbort = Yes Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.InitialR2T = No Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.ImmediateData = Yes Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.FirstBurstLength = 262144 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxBurstLength = 16776192 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Retain = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.DefaultTime2Wait = 2 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxConnections = 1 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.MaxOutstandingR2T = 1 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.iscsi.ERL = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.scan = auto Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.session.reopen_max = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].address = 192.168.40.100 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].port = 3260 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].startup = manual Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].tcp.window_size = 524288 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].tcp.type_of_service = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].timeo.logout_timeout = 15 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].timeo.login_timeout = 15 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].timeo.auth_timeout = 45 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_interval = 5 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].timeo.noop_out_timeout = 5 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.HeaderDigest = None Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.DataDigest = None Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.IFMarker = No Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: node.conn[0].iscsi.OFMarker = No Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: # END RECORD Jul 03 02:44:36.601407 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:36.610680 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:36.619874 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jul 03 02:44:36.619874 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:36.620037 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jul 03 02:44:36.620037 np0000004352 cinder-backup[101397]: {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:36.620096 np0000004352 cinder-backup[101397]: WARNING os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jul 03 02:44:36.620096 np0000004352 cinder-backup[101397]: Jul 03 02:44:36.646746 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:36.646746 np0000004352 cinder-backup[101397]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:36.646746 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:36.655970 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:36.666976 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:36.666976 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:36.667156 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:36.667156 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:36.667409 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:36.667592 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Connected to 192.168.40.100:3260 {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jul 03 02:44:36.668043 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] HCTL ('7', '-', '-', 0) found on session 242 with lun 0 {{(pid=101397) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jul 03 02:44:36.668171 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Scanning host 7 c: -, t: -, l: 0) {{(pid=101397) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jul 03 02:44:36.679747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Searching for a device in session 242 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=101397) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jul 03 02:44:36.679747 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False} {{(pid=101397) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jul 03 02:44:37.681851 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.128s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:37.682278 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] <== connect_volume: return (2129ms) {'type': 'block', 'scsi_wwn': '33000000089372e87', 'path': '/dev/sdb'} {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:37.682318 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:37.699087 np0000004352 sudo[162579]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb Jul 03 02:44:37.699695 np0000004352 sudo[162579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:38.014632 np0000004352 sudo[162579]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:38.017058 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1002 /dev/sdb" returned: 0 in 0.334s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:38.063141 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:38.068340 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _read_sha256file started, container name: volumebackups, sha256 filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_sha256file. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:333}} Jul 03 02:44:38.099502 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _read_sha256file finished. {{(pid=101397) _read_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:340}} Jul 03 02:44:38.108542 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _create_container started, container: volumebackups,backup: a117e5c2-8543-4508-b7e7-ad1a2448a885. {{(pid=101397) _create_container /opt/stack/cinder/cinder/backup/chunkeddriver.py:249}} Jul 03 02:44:38.140586 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] generate_object_name_prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885 {{(pid=101397) _generate_object_name_prefix /opt/stack/cinder/cinder/backup/drivers/swift.py:452}} Jul 03 02:44:38.145667 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] starting backup of volume: 2f0693c1-162c-467c-b993-b77851797cb9, volume size: 1073741824, object names prefix volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885, availability zone: nova {{(pid=101397) _prepare_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:359}} Jul 03 02:44:41.944335 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:79}} Jul 03 02:44:41.950808 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Completed fetching metadata type 'volume-base-metadata' {{(pid=101397) _save_vol_base_meta /opt/stack/cinder/cinder/backup/driver.py:98}} Jul 03 02:44:41.950949 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-metadata' {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:109}} Jul 03 02:44:41.955173 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-metadata' available {{(pid=101397) _save_vol_meta /opt/stack/cinder/cinder/backup/driver.py:123}} Jul 03 02:44:41.955320 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Getting metadata type 'volume-glance-metadata' {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:132}} Jul 03 02:44:41.958256 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.driver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] No metadata type 'volume-glance-metadata' available {{(pid=101397) _save_vol_glance_meta /opt/stack/cinder/cinder/backup/driver.py:147}} Jul 03 02:44:41.958508 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _write_sha256file started, container name: volumebackups, sha256file filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_sha256file. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:299}} Jul 03 02:44:42.014791 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _write_sha256file finished. {{(pid=101397) _write_sha256file /opt/stack/cinder/cinder/backup/chunkeddriver.py:315}} Jul 03 02:44:42.015433 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _write_metadata started, container name: volumebackups, metadata filename: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_metadata. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:276}} Jul 03 02:44:42.038645 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _write_metadata finished. Metadata: b'{\n "backup_description": null,\n "backup_id": "a117e5c2-8543-4508-b7e7-ad1a2448a885",\n "backup_name": "tempest-VolumesBackupsTest-Backup-1211153510",\n "created_at": "2026-07-03 02:44:35+00:00",\n "objects": [],\n "parent_id": "4e2d83d7-7c44-42cd-ab57-5c883003ec08",\n "version": "1.0.0",\n "volume_id": "2f0693c1-162c-467c-b993-b77851797cb9",\n "volume_meta": "{\\"version\\": 2, \\"volume-base-metadata\\": {\\"id\\": \\"2f0693c1-162c-467c-b993-b77851797cb9\\", \\"_name_id\\": null, \\"use_quota\\": true, \\"ec2_id\\": null, \\"user_id\\": \\"8944104afe174b6fb7371bffc9897515\\", \\"project_id\\": \\"1c90cac2fc954e8f9955fb497cbecdee\\", \\"snapshot_id\\": null, \\"cluster_name\\": null, \\"host\\": \\"np0000004352@storpool#template_virtual\\", \\"size\\": 1, \\"availability_zone\\": \\"nova\\", \\"status\\": \\"backing-up\\", \\"attach_status\\": \\"detached\\", \\"migration_status\\": null, \\"scheduled_at\\": \\"2026-07-03T02:43:48.000000\\", \\"launched_at\\": \\"2026-07-03T02:43:48.000000\\", \\"terminated_at\\": null, \\"display_name\\": \\"tempest-VolumesBackupsTest-Volume-1933821741\\", \\"display_description\\": null, \\"provider_location\\": null, \\"provider_auth\\": null, \\"provider_geometry\\": null, \\"provider_id\\": null, \\"volume_type_id\\": \\"cc60d419-a158-4d72-a53e-11fa27beb066\\", \\"source_volid\\": null, \\"encryption_key_id\\": null, \\"consistencygroup_id\\": null, \\"group_id\\": null, \\"bootable\\": false, \\"multiattach\\": false, \\"replication_status\\": null, \\"replication_extended_status\\": null, \\"replication_driver_data\\": null, \\"previous_status\\": \\"available\\", \\"service_uuid\\": \\"7fa41f37-474b-4d2e-ba82-e87b1e368dbb\\", \\"shared_targets\\": true, \\"deleted_at\\": null, \\"deleted\\": false, \\"created_at\\": \\"2026-07-03T02:43:47.000000\\", \\"updated_at\\": \\"2026-07-03T02:44:35.000000\\"}}"\n}'. {{(pid=101397) _write_metadata /opt/stack/cinder/cinder/backup/chunkeddriver.py:295}} Jul 03 02:44:42.044569 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] backup a117e5c2-8543-4508-b7e7-ad1a2448a885 finished. {{(pid=101397) _finalize_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:462}} Jul 03 02:44:42.168394 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 02:44:42.188096 np0000004352 sudo[162583]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Jul 03 02:44:42.188795 np0000004352 sudo[162583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jul 03 02:44:42.480466 np0000004352 sudo[162583]: pam_unix(sudo:session): session closed for user root Jul 03 02:44:42.482322 np0000004352 cinder-backup[101397]: DEBUG oslo_concurrency.processutils [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.314s {{(pid=101397) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 02:44:42.482890 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] ==> disconnect_volume: call "{'args': (, {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, {'type': 'block', 'scsi_wwn': '33000000089372e87', 'path': '/dev/sdb'}), 'kwargs': {'force': True, 'ignore_errors': True}}" {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jul 03 02:44:42.483031 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jul 03 02:44:42.483525 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jul 03 02:44:42.483882 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] _get_connection_devices called with parameters: connection_properties={'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f0693c1-162c-467c-b993-b77851797cb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': False}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: iSNS: Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: STATIC: Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: Target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: Portal: 192.168.40.100:3260,-1 Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: Iface Name: default Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: FIRMWARE: Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: No targets found. Jul 03 02:44:42.493242 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:42.493723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Regex to get portals from discoverydb: ^SENDTARGETS: Jul 03 02:44:42.493723 np0000004352 cinder-backup[101397]: .*?^DiscoveryAddress: 192.168.40.100,3260.*? Jul 03 02:44:42.493723 np0000004352 cinder-backup[101397]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=101397) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:390}} Jul 03 02:44:42.493723 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', 0)] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jul 03 02:44:42.512076 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('-m', 'session'): stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:42.512076 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jul 03 02:44:42.512270 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsi session list stdout=tcp: [242] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9 (non-flash) Jul 03 02:44:42.512270 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jul 03 02:44:42.512430 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '242')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jul 03 02:44:42.512638 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9', '242')] {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jul 03 02:44:42.513581 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Resulting device map defaultdict(. at 0x7835850902c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9'): ({'sdb'}, set())}) {{(pid=101397) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jul 03 02:44:42.513827 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Removing single pathed devices sdb {{(pid=101397) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jul 03 02:44:42.523944 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Flushing IO for device /dev/sdb {{(pid=101397) flush_device_io /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:461}} Jul 03 02:44:42.532114 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=101397) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jul 03 02:44:42.572071 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jul 03 02:44:42.572295 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] SCSI volumes sdb have been removed. {{(pid=101397) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jul 03 02:44:42.573316 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Checking to see if device paths {'sdb'} are still under multipathd monitoring {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jul 03 02:44:42.585535 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.linuxscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Device paths {'sdb'} have been removed from multipathd monitoring. {{(pid=101397) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jul 03 02:44:42.585769 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9')] {{(pid=101397) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jul 03 02:44:42.596389 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:42.625218 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 242, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] Jul 03 02:44:42.625218 np0000004352 cinder-backup[101397]: Logout of [sid: 242, target: iqn.2023-03.storpool.com:os--volume-2f0693c1-162c-467c-b993-b77851797cb9, portal: 192.168.40.100,3260] successful. Jul 03 02:44:42.625218 np0000004352 cinder-backup[101397]: stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:42.636146 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=101397) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jul 03 02:44:42.636436 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.base [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.153s {{(pid=101397) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jul 03 02:44:42.636589 np0000004352 cinder-backup[101397]: DEBUG os_brick.initiator.connectors.iscsi [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] <== disconnect_volume: return (153ms) None {{(pid=101397) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jul 03 02:44:43.667540 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-72147032-a795-421e-a8a0-b7e5f8f5ced5 tempest-VolumesBackupsTest-986908416 None] Create backup finished. backup: a117e5c2-8543-4508-b7e7-ad1a2448a885. Jul 03 02:44:44.179348 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] Delete backup started, backup: a117e5c2-8543-4508-b7e7-ad1a2448a885. Jul 03 02:44:44.182684 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:44.182821 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:44.182968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] delete started, backup: a117e5c2-8543-4508-b7e7-ad1a2448a885, container: volumebackups, prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:44:44.221880 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] generated object list: ['volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_metadata', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:44:44.242359 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:44.262991 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024438/az_nova_backup_a117e5c2-8543-4508-b7e7-ad1a2448a885_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:44.263241 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] delete a117e5c2-8543-4508-b7e7-ad1a2448a885 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:44:44.300800 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:44.318977 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] Created reservations ['8295b2f9-3dc5-46de-966b-8b0e6aa64a76', '96a37b11-2346-4a13-afd9-ec08cf2efe00'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:44:44.356686 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-281778d0-b1d2-45f4-b01f-f25c71e2d711 tempest-VolumesBackupsTest-986908416 None] Delete backup finished, backup a117e5c2-8543-4508-b7e7-ad1a2448a885 deleted. Jul 03 02:44:45.250621 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] Delete backup started, backup: 1ed45c53-47dd-4c16-a226-4b2703a3955e. Jul 03 02:44:45.253269 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:45.253551 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:45.253719 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] delete started, backup: 1ed45c53-47dd-4c16-a226-4b2703a3955e, container: volumebackups, prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:44:45.302559 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] generated object list: ['volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_metadata', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:44:45.326980 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:45.351783 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024427/az_nova_backup_1ed45c53-47dd-4c16-a226-4b2703a3955e_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:45.352038 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] delete 1ed45c53-47dd-4c16-a226-4b2703a3955e finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:44:45.387298 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:45.402435 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] Created reservations ['f4ea04b8-ddb9-4414-96ef-60e6d7b2bdad', '19b010cf-f97d-4057-b99b-b34c3a7924fc'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:44:45.430624 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-a2eaa53d-ffb4-4784-a8eb-514038553466 tempest-VolumesBackupsTest-483130512 None] Delete backup finished, backup 1ed45c53-47dd-4c16-a226-4b2703a3955e deleted. Jul 03 02:44:46.316704 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] Delete backup started, backup: 4e2d83d7-7c44-42cd-ab57-5c883003ec08. Jul 03 02:44:46.319209 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_1c90cac2fc954e8f9955fb497cbecdee {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:46.319386 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:46.319622 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] delete started, backup: 4e2d83d7-7c44-42cd-ab57-5c883003ec08, container: volumebackups, prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:44:46.364750 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] generated object list: ['volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00001', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00002', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00003', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00004', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00005', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00006', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00007', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00008', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00009', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00010', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00011', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00012', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00013', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00014', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00015', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00016', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00017', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00018', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00019', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00020', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00021', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_metadata', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:44:46.384208 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.403011 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.422466 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.441846 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.466147 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.487210 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.507805 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.528007 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.548451 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.566511 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.587383 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.605375 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.623909 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.642778 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.664153 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.685137 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.706784 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.726870 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.749442 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.775962 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.795695 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.818039 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.842561 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024410/az_nova_backup_4e2d83d7-7c44-42cd-ab57-5c883003ec08_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:46.842869 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] delete 4e2d83d7-7c44-42cd-ab57-5c883003ec08 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:44:46.880549 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:46.896904 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] Created reservations ['564b2df3-a697-4bd5-8f80-1820b074f44c', '2aa0f59f-54f9-4ca2-95df-b9d157c07fdd'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:44:46.919076 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-e64671b7-b227-4390-87d8-c43aae4c060a tempest-VolumesBackupsTest-986908416 None] Delete backup finished, backup 4e2d83d7-7c44-42cd-ab57-5c883003ec08 deleted. Jul 03 02:44:47.385195 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] Delete backup started, backup: 9fa1b327-dafa-4ce8-9db4-257604a409d7. Jul 03 02:44:47.387982 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] Using swift URL https://10.4.3.223:8080/v1/AUTH_bda7a6a35b64470488d330119aff58ac {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:300}} Jul 03 02:44:47.388170 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.drivers.swift [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] Connect to https://10.4.3.223:8080/v1/AUTH_ in "per_user" mode {{(pid=101397) initialize /opt/stack/cinder/cinder/backup/drivers/swift.py:301}} Jul 03 02:44:47.388328 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] delete started, backup: 9fa1b327-dafa-4ce8-9db4-257604a409d7, container: volumebackups, prefix: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:822}} Jul 03 02:44:47.430385 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] generated object list: ['volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00001', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00002', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00003', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00004', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00005', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00006', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00007', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00008', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00009', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00010', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00011', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00012', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00013', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00014', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00015', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00016', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00017', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00018', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00019', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00020', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00021', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_metadata', 'volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_sha256file']. {{(pid=101397) _generate_object_names /opt/stack/cinder/cinder/backup/chunkeddriver.py:260}} Jul 03 02:44:47.453361 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00001 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.472601 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00002 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.492786 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00003 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.514656 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00004 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.534231 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00005 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.556868 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00006 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.576828 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00007 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.597604 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00008 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.616825 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00009 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.639968 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00010 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.659815 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00011 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.681901 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00012 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.704158 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00013 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.724651 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00014 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.747624 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00015 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.768756 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00016 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.790435 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00017 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.813611 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00018 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.834189 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00019 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.856563 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00020 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.878267 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7-00021 in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.899495 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_metadata in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.921596 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] deleted object: volume_2f0693c1-162c-467c-b993-b77851797cb9/20260703024351/az_nova_backup_9fa1b327-dafa-4ce8-9db4-257604a409d7_sha256file in container: volumebackups. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:838}} Jul 03 02:44:47.921840 np0000004352 cinder-backup[101397]: DEBUG cinder.backup.chunkeddriver [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] delete 9fa1b327-dafa-4ce8-9db4-257604a409d7 finished. {{(pid=101397) delete_backup /opt/stack/cinder/cinder/backup/chunkeddriver.py:848}} Jul 03 02:44:47.954724 np0000004352 cinder-backup[101397]: DEBUG oslo_db.sqlalchemy.engines [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101397) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 02:44:47.968551 np0000004352 cinder-backup[101397]: DEBUG cinder.quota [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] Created reservations ['258b7063-39cc-46ce-aaae-139a021ae54b', 'a2ef9b6e-955d-4f33-89c9-0e4c1974d94e'] {{(pid=101397) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 02:44:47.982588 np0000004352 cinder-backup[101397]: INFO cinder.backup.manager [None req-0d14d14f-05c5-4267-b6f2-a561aea68032 tempest-VolumesBackupsTest-483130512 None] Delete backup finished, backup 9fa1b327-dafa-4ce8-9db4-257604a409d7 deleted. Jul 03 02:45:03.089331 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:45:03.089704 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:45:06.053702 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:UPDATE=37,cinder:SELECT=65,cinder:INSERT=8 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:46:03.092881 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:46:03.093391 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:47:03.096793 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:47:03.097288 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:47:06.055736 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 02:48:03.100689 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:48:03.101137 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:49:03.104314 np0000004352 cinder-backup[101397]: DEBUG oslo_service.periodic_task [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Running periodic task BackupManager.publish_service_capabilities {{(pid=101397) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 02:49:03.104892 np0000004352 cinder-backup[101397]: DEBUG cinder.manager [None req-add03609-8211-49e5-8a82-5fd19bdaf9c9 None None] Notifying Schedulers of capabilities ... {{(pid=101397) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 02:49:06.056108 np0000004352 cinder-backup[101397]: DEBUG dbcounter [-] [101397] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=101397) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}